Aug 05 17:12:29.996428 ip-10-0-136-107 systemd[1]: Starting Kubernetes Kubelet... Aug 05 17:12:30.425375 ip-10-0-136-107 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:30.425375 ip-10-0-136-107 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 17:12:30.425375 ip-10-0-136-107 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:30.425375 ip-10-0-136-107 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 17:12:30.425375 ip-10-0-136-107 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:30.426079 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.425432 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 17:12:30.430862 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430833 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.430862 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430853 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.430862 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430861 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.430862 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430866 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.430862 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430870 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430874 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430877 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430880 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430883 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430886 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430890 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430892 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430896 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430899 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430901 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430904 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430907 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430909 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430912 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430919 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430922 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430924 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430929 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.431076 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430933 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430936 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430939 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430942 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430944 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430947 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430951 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430954 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430957 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430959 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430962 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430965 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430968 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430970 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430974 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430978 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430982 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430984 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430987 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430990 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.431556 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430993 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430995 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.430998 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431001 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431003 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431006 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431009 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431013 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431015 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431018 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431021 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431024 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431026 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431029 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431031 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431034 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431036 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431039 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431041 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431044 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.432041 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431047 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431049 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431052 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431055 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431058 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431060 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431063 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431067 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431070 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431073 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431076 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431080 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431082 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431085 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431090 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431092 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431095 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431098 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431100 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431103 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.432585 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431106 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431109 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431112 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431116 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431119 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431122 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431125 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431147 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431152 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431156 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431159 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431162 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431164 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431167 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431170 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431172 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431893 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431903 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431907 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.433068 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431911 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431914 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431917 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431920 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431923 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431926 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431929 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431931 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431934 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431937 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431940 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431943 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431945 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431948 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431952 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431955 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431958 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431960 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431963 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431966 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.433546 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431968 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431970 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431973 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431976 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431978 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431980 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431984 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431987 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431989 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431992 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431995 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.431998 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432001 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432004 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432006 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432009 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432011 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432014 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432016 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.434047 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432019 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432021 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432024 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432027 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432029 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432031 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432034 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432036 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432040 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432044 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432048 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432051 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432054 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432057 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432060 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432063 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432066 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432068 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432071 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.434537 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432074 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432077 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432082 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432084 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432087 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432091 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432094 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432097 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432100 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432102 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432105 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432107 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432111 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432113 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432116 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432118 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432121 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432124 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432141 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.434992 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432144 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432146 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432150 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432153 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432155 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432158 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432160 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432163 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432165 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432168 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432170 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432173 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432176 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432178 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432181 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432184 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432190 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432193 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432612 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432618 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.435504 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432621 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432624 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432627 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432630 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432633 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432635 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432638 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432640 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432643 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432645 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432649 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432651 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432654 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432656 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432659 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432662 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432664 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432667 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432669 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432671 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432674 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.435973 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432677 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432679 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432682 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432684 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432687 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432690 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432692 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432697 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432700 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432703 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432705 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432708 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432712 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432716 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432719 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432722 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432725 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432727 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432730 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432732 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.436502 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432735 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432738 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432740 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432743 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432746 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432748 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432751 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432754 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432756 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432759 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432761 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432764 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432772 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432774 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432777 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432781 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432785 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432788 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432790 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.437026 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432795 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432798 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432801 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432803 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432806 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432809 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432811 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432814 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432816 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432819 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432821 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432824 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432826 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432830 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432833 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432836 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432838 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432841 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432843 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.437505 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432846 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432849 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432852 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432854 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432857 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432859 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432861 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432864 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432866 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432869 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432872 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432875 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432877 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432881 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432884 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432886 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432888 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.432892 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432962 2579 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432970 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 17:12:30.437991 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432979 2579 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432985 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432992 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.432996 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433003 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433008 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433011 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433014 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433017 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433021 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433024 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433027 2579 flags.go:64] FLAG: --cgroup-root="" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433030 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433033 2579 flags.go:64] FLAG: --client-ca-file="" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433037 2579 flags.go:64] FLAG: --cloud-provider="external" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433041 2579 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433045 2579 flags.go:64] FLAG: --cluster-domain="" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433048 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433051 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433054 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433058 2579 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433062 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433065 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 17:12:30.438541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433068 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433072 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433076 2579 flags.go:64] FLAG: --contention-profiling="false" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433079 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433082 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433086 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433089 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433093 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433096 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433099 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433102 2579 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433105 2579 flags.go:64] FLAG: --enable-server="true" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433107 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433112 2579 flags.go:64] FLAG: --event-burst="100" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433115 2579 flags.go:64] FLAG: --event-qps="50" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433118 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433121 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433124 2579 flags.go:64] FLAG: --eviction-hard="" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433140 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433143 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433146 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433149 2579 flags.go:64] FLAG: --eviction-soft="" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433152 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433155 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433158 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 17:12:30.439096 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433161 2579 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433164 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433167 2579 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433170 2579 flags.go:64] FLAG: --feature-gates="" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433175 2579 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433178 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433181 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433184 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433187 2579 flags.go:64] FLAG: --healthz-port="10248" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433191 2579 flags.go:64] FLAG: --help="false" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433194 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-107.ec2.internal" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433197 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433200 2579 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433204 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433207 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433211 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433214 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433217 2579 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433220 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433223 2579 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433226 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433229 2579 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433232 2579 flags.go:64] FLAG: --kube-reserved="" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433234 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 17:12:30.439766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433237 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433240 2579 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433243 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433246 2579 flags.go:64] FLAG: --lock-file="" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433249 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433252 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433255 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433260 2579 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433264 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433267 2579 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433270 2579 flags.go:64] FLAG: --logging-format="text" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433273 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433278 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433281 2579 flags.go:64] FLAG: --manifest-url="" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433283 2579 flags.go:64] FLAG: --manifest-url-header="" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433288 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433291 2579 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433296 2579 flags.go:64] FLAG: --max-pods="110" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433299 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433302 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433305 2579 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433308 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433311 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433314 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433317 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 17:12:30.440390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433324 2579 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433328 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433331 2579 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433334 2579 flags.go:64] FLAG: --pod-cidr="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433337 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433343 2579 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433346 2579 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433349 2579 flags.go:64] FLAG: --pods-per-core="0" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433352 2579 flags.go:64] FLAG: --port="10250" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433355 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433358 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ae78974baa3500b" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433361 2579 flags.go:64] FLAG: --qos-reserved="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433364 2579 flags.go:64] FLAG: --read-only-port="10255" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433367 2579 flags.go:64] FLAG: --register-node="true" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433370 2579 flags.go:64] FLAG: --register-with-taints="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433374 2579 flags.go:64] FLAG: --registry-burst="10" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433377 2579 flags.go:64] FLAG: --registry-qps="5" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433381 2579 flags.go:64] FLAG: --reserved-cpus="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433384 2579 flags.go:64] FLAG: --reserved-memory="" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433388 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433393 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433396 2579 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433399 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433402 2579 flags.go:64] FLAG: --runonce="false" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433405 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 17:12:30.441051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433408 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433411 2579 flags.go:64] FLAG: --seccomp-default="false" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433414 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433417 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433420 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433423 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433426 2579 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433429 2579 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433432 2579 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433435 2579 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433438 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433441 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433444 2579 flags.go:64] FLAG: --system-cgroups="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433447 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433452 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433455 2579 flags.go:64] FLAG: --tls-cert-file="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433457 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433462 2579 flags.go:64] FLAG: --tls-min-version="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433464 2579 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433467 2579 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433470 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433473 2579 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433476 2579 flags.go:64] FLAG: --v="2" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433480 2579 flags.go:64] FLAG: --version="false" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433484 2579 flags.go:64] FLAG: --vmodule="" Aug 05 17:12:30.441687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433488 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433491 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433626 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433631 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433634 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433637 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433640 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433642 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433645 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433648 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433650 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433653 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433656 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433659 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433661 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433664 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433666 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433670 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433673 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433675 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.442306 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433678 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433680 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433683 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433685 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433688 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433690 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433693 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433696 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433698 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433701 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433703 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433706 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433711 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433714 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433718 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433721 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433723 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433725 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433730 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433732 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.442804 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433735 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433737 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433740 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433743 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433745 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433748 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433751 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433753 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433756 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433758 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433761 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433764 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433766 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433769 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433771 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433775 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433778 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433781 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433784 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433787 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.443309 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433789 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433792 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433794 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433797 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433799 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433802 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433806 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433810 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433814 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433817 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433821 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433825 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433828 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433831 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433834 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433837 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433839 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433842 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433845 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.443798 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433848 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433850 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433853 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433856 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433858 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433861 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433863 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433866 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433869 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433871 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433874 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433876 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433879 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433882 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433884 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433886 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433889 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433891 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433894 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.444291 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433899 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433902 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.433905 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.433911 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.440774 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.440791 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.440805 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.440811 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440877 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440882 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440886 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440889 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440894 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440898 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.444805 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440901 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440905 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440908 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440911 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440914 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440917 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440920 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440923 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440926 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440928 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440931 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440934 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440937 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440939 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440942 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440945 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440950 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440952 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440955 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.445180 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440958 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440960 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440963 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440967 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440970 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440972 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440975 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440978 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440980 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440983 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440985 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440988 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440990 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440993 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440995 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.440998 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441000 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441003 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441005 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441008 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.445668 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441010 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441013 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441016 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441018 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441021 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441023 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441026 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441028 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441031 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441033 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441036 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441038 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441041 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441043 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441048 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441051 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441056 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441059 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441063 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441065 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.446490 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441068 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441071 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441074 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441076 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441079 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441082 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441084 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441087 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441089 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441092 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441095 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441098 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441100 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441103 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441106 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441109 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441111 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441114 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441116 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.447014 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441119 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441122 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441124 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441139 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441142 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441145 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441147 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441150 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441153 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441156 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441160 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441163 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441167 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441170 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.441175 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:30.447501 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441314 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441320 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441323 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441326 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441329 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441332 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441335 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441338 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441341 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441344 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441346 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441349 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441352 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441355 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441357 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441360 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441363 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441365 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441368 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441371 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:30.447887 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441374 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441376 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441379 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441382 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441385 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441387 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441391 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441394 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441397 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441399 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441402 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441405 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441407 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441411 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441415 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441418 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441422 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441425 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441427 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:30.448372 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441430 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441433 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441435 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441437 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441440 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441442 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441445 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441448 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441450 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441452 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441455 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441457 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441460 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441462 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441465 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441469 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441472 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441475 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441478 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:30.448816 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441481 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441484 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441487 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441491 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441494 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441497 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441500 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441502 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441505 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441507 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441510 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441512 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441514 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441517 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441520 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441522 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441525 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441527 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441529 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441532 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:30.449322 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441534 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441537 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441539 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441542 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441544 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441547 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441549 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441551 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441555 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441559 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441562 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441564 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441567 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441569 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441572 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441574 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441577 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441580 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441582 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441585 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:30.449823 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:30.441587 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.441593 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.441711 2579 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.444326 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.445795 2579 server.go:1019] "Starting client certificate rotation" Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.445913 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.445969 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:30.450397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.449318 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:30.450926 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:30.450894 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:31.684580 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.684557 2579 log.go:25] "Validated CRI v1 runtime API" Aug 05 17:12:31.687838 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.687819 2579 log.go:25] "Validated CRI v1 image API" Aug 05 17:12:31.689678 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.689658 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 17:12:31.693658 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.693639 2579 fs.go:135] Filesystem UUIDs: map[3faeb317-56f1-4bd0-bbbd-2fd3b9229ff0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ecec9745-bd5f-4dd0-b8bf-a655d84a0b05:/dev/nvme0n1p4] Aug 05 17:12:31.693708 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.693658 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 17:12:31.699059 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.698942 2579 manager.go:216] Machine: {Timestamp:2026-08-05 17:12:31.697753065 +0000 UTC m=+0.360489716 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104712 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f9edaac7fef49b565385d6d2848ec SystemUUID:ec2f9eda-ac7f-ef49-b565-385d6d2848ec BootID:841fb5b2-5173-4bfd-afed-d6ff8210c9e3 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:00:7f:0a:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:00:7f:0a:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:86:1c:c1:4a:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 17:12:31.699059 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.699053 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 17:12:31.699176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.699142 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 17:12:31.699437 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.699418 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:31.702069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.702038 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 17:12:31.702222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.702073 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 17:12:31.703770 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.703758 2579 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 17:12:31.703814 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.703772 2579 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 17:12:31.703814 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.703781 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:31.704385 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.704376 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:31.705178 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.705169 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 17:12:31.708428 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708404 2579 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:31.708561 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708550 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 17:12:31.708602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708583 2579 kubelet.go:486] "Attempting to sync node with API server" Aug 05 17:12:31.708602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708598 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 17:12:31.708657 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708613 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 17:12:31.708657 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708624 2579 kubelet.go:398] "Adding apiserver pod source" Aug 05 17:12:31.708657 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.708637 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 17:12:31.709085 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.709073 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:31.709120 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.709093 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:31.711493 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.711477 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 17:12:31.712824 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.712808 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 17:12:31.712874 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.712840 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 17:12:31.713855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713843 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 17:12:31.713894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713863 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 17:12:31.713894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713869 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 17:12:31.713894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713876 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 17:12:31.713894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713886 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 17:12:31.713894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713891 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713900 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713905 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713918 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713923 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713935 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 17:12:31.714033 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.713941 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 17:12:31.714631 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.714619 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 17:12:31.714676 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.714642 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 17:12:31.718097 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.718082 2579 server.go:1268] "Started kubelet" Aug 05 17:12:31.718394 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.718357 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 17:12:31.718753 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.718535 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 17:12:31.718859 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.718843 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 17:12:31.719197 ip-10-0-136-107 systemd[1]: Started Kubernetes Kubelet. Aug 05 17:12:31.720143 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.720117 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 17:12:31.720223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.720199 2579 server.go:310] "Adding debug handlers to kubelet server" Aug 05 17:12:31.722151 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.722127 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 17:12:31.722222 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.722142 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 17:12:31.722222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.722215 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 17:12:31.724251 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.724225 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 17:12:31.725253 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.725236 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 17:12:31.725355 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.725253 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:31.725439 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.725398 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:31.726281 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726152 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 17:12:31.726389 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726377 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 17:12:31.726602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726140 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 17:12:31.726765 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726747 2579 reconstruct.go:97] "Volume reconstruction finished" Aug 05 17:12:31.726765 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726762 2579 reconciler.go:29] "Reconciler: start to sync state" Aug 05 17:12:31.726908 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726783 2579 factory.go:55] Registering systemd factory Aug 05 17:12:31.726908 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.726824 2579 factory.go:223] Registration of the systemd container factory successfully Aug 05 17:12:31.728602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.728585 2579 factory.go:153] Registering CRI-O factory Aug 05 17:12:31.728602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.728604 2579 factory.go:223] Registration of the crio container factory successfully Aug 05 17:12:31.728718 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.728691 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 17:12:31.728751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.728734 2579 factory.go:103] Registering Raw factory Aug 05 17:12:31.728782 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.728757 2579 manager.go:1196] Started watching for new ooms in manager Aug 05 17:12:31.729489 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.729456 2579 manager.go:349] Starting recovery of all containers Aug 05 17:12:31.733314 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.733283 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 17:12:31.733435 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.733363 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 17:12:31.734380 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.733120 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c8f804cac7b356 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-08-05 17:12:31.718044502 +0000 UTC m=+0.380781155,LastTimestamp:2026-08-05 17:12:31.718044502 +0000 UTC m=+0.380781155,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Aug 05 17:12:31.735720 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.735692 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hmg6" Aug 05 17:12:31.740289 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.740273 2579 manager.go:354] Recovery completed Aug 05 17:12:31.741540 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.741514 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Aug 05 17:12:31.743975 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.743956 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2hmg6" Aug 05 17:12:31.744548 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.744537 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:31.746306 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746294 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:31.746360 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746319 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:31.746360 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746330 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:31.746940 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746923 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 17:12:31.746940 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746931 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:31.746940 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746938 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 17:12:31.747119 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.746956 2579 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:31.747635 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747623 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:31.747702 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747645 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:31.747702 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747655 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:31.747880 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747870 2579 policy_none.go:49] "None policy: Start" Aug 05 17:12:31.747912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747885 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 17:12:31.747912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.747895 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 17:12:31.748615 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.748552 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c8f804cc76f1f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-08-05 17:12:31.746306548 +0000 UTC m=+0.409043199,LastTimestamp:2026-08-05 17:12:31.746306548 +0000 UTC m=+0.409043199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Aug 05 17:12:31.748936 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.748925 2579 policy_none.go:47] "Start" Aug 05 17:12:31.781252 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781065 2579 manager.go:337] "Starting Device Plugin manager" Aug 05 17:12:31.781362 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.781291 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 17:12:31.781362 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781307 2579 server.go:87] "Starting device plugin registration server" Aug 05 17:12:31.781618 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781604 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 17:12:31.781678 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781622 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 17:12:31.781746 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781727 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 17:12:31.781827 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781815 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 17:12:31.781872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.781850 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 17:12:31.782371 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.782341 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 17:12:31.782466 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.782395 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:31.882660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.882624 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:31.883718 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.883698 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:31.883797 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.883731 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:31.883797 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.883742 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:31.883797 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.883770 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-107.ec2.internal" Aug 05 17:12:31.891963 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.891934 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-107.ec2.internal" Aug 05 17:12:31.892032 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.891967 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-107.ec2.internal\": node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:31.899827 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.899739 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 17:12:31.900878 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.900864 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 17:12:31.900937 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.900900 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 17:12:31.900937 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.900921 2579 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 17:12:31.901008 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.900951 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 17:12:31.902754 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:31.902734 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:31.903401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:31.903382 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:32.001430 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.001371 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal"] Aug 05 17:12:32.001619 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.001522 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:32.002619 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.002602 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:32.002682 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.002636 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:32.002682 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.002647 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:32.002952 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.002930 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.004220 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004208 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:32.004344 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.004401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004368 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:32.004965 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004947 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:32.005040 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004976 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:32.005040 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004989 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:32.005040 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.004949 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:32.005126 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.005056 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:32.005126 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.005070 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:32.006202 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.006188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.006247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.006214 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:32.006929 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.006907 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:32.007005 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.006931 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:32.007005 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.006946 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:32.028891 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.028861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.029021 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.028894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.029021 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.028913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a04f0d69322552c16be42899defc244b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"a04f0d69322552c16be42899defc244b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.034305 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.034287 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-107.ec2.internal\" not found" node="ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.039070 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.039050 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-107.ec2.internal\" not found" node="ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.103203 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.103166 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.129351 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a04f0d69322552c16be42899defc244b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"a04f0d69322552c16be42899defc244b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.129473 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.129473 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.129473 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a04f0d69322552c16be42899defc244b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"a04f0d69322552c16be42899defc244b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.129473 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.129615 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.129475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9354fc9681ea7b93947172651a4c1e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"e9354fc9681ea7b93947172651a4c1e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.203700 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.203623 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.304387 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.304342 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.336954 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.336926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.342235 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.342218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:32.404770 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.404718 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.505376 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.505309 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.599713 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.599687 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:32.605668 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.605642 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.666310 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.666280 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 17:12:32.666731 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.666444 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 17:12:32.666731 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.666468 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 17:12:32.706608 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.706581 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.748160 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.748117 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:07:31 +0000 UTC" deadline="2028-01-14 12:59:06.9929483 +0000 UTC" Aug 05 17:12:32.748160 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.748150 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12643h46m34.244803029s" Aug 05 17:12:32.807516 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.807432 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.907542 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:32.907518 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:32.987791 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:32.987755 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9354fc9681ea7b93947172651a4c1e2.slice/crio-65619e8479d3d706eb312a7eb3629a6ef2cfcba32e3fa60171a1aeb56bedbcf2 WatchSource:0}: Error finding container 65619e8479d3d706eb312a7eb3629a6ef2cfcba32e3fa60171a1aeb56bedbcf2: Status 404 returned error can't find the container with id 65619e8479d3d706eb312a7eb3629a6ef2cfcba32e3fa60171a1aeb56bedbcf2 Aug 05 17:12:32.994451 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:32.994430 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:12:33.007893 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.007870 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Aug 05 17:12:33.039353 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.039322 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:33.048010 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.047993 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:33.125910 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.125824 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Aug 05 17:12:33.136992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.136970 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:33.138502 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.138488 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Aug 05 17:12:33.151992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.151970 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:33.435102 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:33.435077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04f0d69322552c16be42899defc244b.slice/crio-2ba5a43123edb9faf0acc9819b7d47481b03dfa64891e1a631bf7c7cf9e544fe WatchSource:0}: Error finding container 2ba5a43123edb9faf0acc9819b7d47481b03dfa64891e1a631bf7c7cf9e544fe: Status 404 returned error can't find the container with id 2ba5a43123edb9faf0acc9819b7d47481b03dfa64891e1a631bf7c7cf9e544fe Aug 05 17:12:33.518993 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.518965 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:33.710789 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.710706 2579 apiserver.go:52] "Watching apiserver" Aug 05 17:12:33.716489 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.716463 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 17:12:33.716857 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.716834 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zxv4c","openshift-cluster-node-tuning-operator/tuned-x8s2w","openshift-image-registry/node-ca-49sdz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-b4tlz","openshift-multus/multus-hhkcx","openshift-multus/network-metrics-daemon-rpbtn","openshift-ovn-kubernetes/ovnkube-node-x55zr","kube-system/konnectivity-agent-np6sw","kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2","openshift-dns/node-resolver-t29x8","openshift-network-diagnostics/network-check-target-fgnlr","openshift-network-operator/iptables-alerter-4xhrh"] Aug 05 17:12:33.718304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.718285 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:33.718427 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.718349 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:33.719219 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.719205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.720097 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.720074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.721054 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.721033 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4f2n\"" Aug 05 17:12:33.721150 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.721097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.721209 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.721159 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.721261 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.721235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.722786 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.722757 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 17:12:33.722908 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.722808 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.723284 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.722986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.723284 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.722757 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flk8w\"" Aug 05 17:12:33.724277 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 17:12:33.724277 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724121 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 17:12:33.724277 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724158 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 17:12:33.724502 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724347 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.724502 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724421 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.725673 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.724976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cq9tv\"" Aug 05 17:12:33.725673 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.725323 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.725673 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.725375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 17:12:33.725673 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.725476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.725673 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.725552 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:33.725944 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.725755 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:33.726369 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.726348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mwcfr\"" Aug 05 17:12:33.727158 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.727138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.728175 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.728155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.729004 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.728987 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.729260 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729242 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 17:12:33.729596 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.729596 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.729713 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729696 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 17:12:33.729881 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729860 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r6cl4\"" Aug 05 17:12:33.729981 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729900 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 17:12:33.730040 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.729994 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 17:12:33.730107 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.730039 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-56jxq\"" Aug 05 17:12:33.730142 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.730122 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 17:12:33.730233 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.730217 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 17:12:33.730470 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.730457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.730526 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.730513 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:33.731687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.731524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.731687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.731555 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 17:12:33.731687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.731563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.731687 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.731581 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hphct\"" Aug 05 17:12:33.731919 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.731789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.732802 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.732780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.734280 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.734366 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84msk\"" Aug 05 17:12:33.734366 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734359 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 17:12:33.734554 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734502 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.734809 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734790 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 17:12:33.734904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734794 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpwd7\"" Aug 05 17:12:33.734974 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.734919 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 17:12:33.736444 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-slash\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.736515 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-system-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.736567 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-bin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.736567 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-kubelet\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.736671 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-modprobe-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.736671 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-cnibin\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.736671 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-run\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.736671 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq7h9\" (UniqueName: \"kubernetes.io/projected/dca48459-5605-4104-aea6-312dec5aa79b-kube-api-access-sq7h9\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-netns\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-kubernetes\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlh49\" (UniqueName: \"kubernetes.io/projected/a4d15ffe-a70c-4251-9109-15471c53c56f-kube-api-access-qlh49\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52e85a9e-ea75-424e-89c3-9a7853635c86-host\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.736863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-kubelet\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-netns\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-system-cni-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-systemd-units\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-env-overrides\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.736974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-conf\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-var-lib-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-etc-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-bin\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shr7f\" (UniqueName: \"kubernetes.io/projected/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-kube-api-access-shr7f\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-os-release\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-multus\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-etc-kubernetes\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-var-lib-kubelet\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-tmp\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovn-node-metrics-cert\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-cni-binary-copy\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e85a9e-ea75-424e-89c3-9a7853635c86-serviceca\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncns\" (UniqueName: \"kubernetes.io/projected/52e85a9e-ea75-424e-89c3-9a7853635c86-kube-api-access-rncns\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.737313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-netd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-script-lib\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-systemd\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-hostroot\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-conf-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysconfig\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-os-release\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-socket-dir-parent\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-sys\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-host\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-etc-tuned\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-cnibin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.737694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737676 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-k8s-cni-cncf-io\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-lib-modules\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-node-log\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-log-socket\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-config\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-daemon-config\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737897 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-systemd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-ovn\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.737999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9j97\" (UniqueName: \"kubernetes.io/projected/1e92259e-3325-4cd9-a758-35dc8276f036-kube-api-access-k9j97\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.738030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6b84\" (UniqueName: \"kubernetes.io/projected/119bbf88-fdb1-4fca-ade3-77a093f94d26-kube-api-access-w6b84\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.738065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.738121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.738088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.738643 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.738104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-multus-certs\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.774338 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.774314 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8558" Aug 05 17:12:33.782717 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.782695 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8558" Aug 05 17:12:33.827635 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.827601 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 17:12:33.838754 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-var-lib-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.838912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-etc-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.838912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-var-lib-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.838912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-bin\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-etc-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-bin\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.838909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shr7f\" (UniqueName: \"kubernetes.io/projected/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-kube-api-access-shr7f\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-os-release\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.839068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-multus\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-etc-kubernetes\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-var-lib-kubelet\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-tmp\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovn-node-metrics-cert\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-cni-binary-copy\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e85a9e-ea75-424e-89c3-9a7853635c86-serviceca\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncns\" (UniqueName: \"kubernetes.io/projected/52e85a9e-ea75-424e-89c3-9a7853635c86-kube-api-access-rncns\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-netd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-script-lib\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-socket-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-sys-fs\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-systemd\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-hostroot\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-conf-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysconfig\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-multus\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-os-release\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-socket-dir-parent\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839652 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-os-release\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dr2\" (UniqueName: \"kubernetes.io/projected/1a605a4f-fdab-496a-a599-e49eed4f3a1c-kube-api-access-r7dr2\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-cni-netd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-var-lib-kubelet\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-sys\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-host\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.839811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-socket-dir-parent\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-openvswitch\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-systemd\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-hostroot\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839942 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-os-release\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-conf-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-etc-tuned\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-sys\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-cnibin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-host\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-dbus\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4911667-a44a-40ce-8d4f-1a20ca952db2-host-slash\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rt9\" (UniqueName: \"kubernetes.io/projected/f4911667-a44a-40ce-8d4f-1a20ca952db2-kube-api-access-h2rt9\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-k8s-cni-cncf-io\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-cnibin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840171 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840205 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-k8s-cni-cncf-io\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysconfig\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.840429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-etc-kubernetes\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840289 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e85a9e-ea75-424e-89c3-9a7853635c86-serviceca\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-lib-modules\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-node-log\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-lib-modules\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-node-log\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840390 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-script-lib\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.839913 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4911667-a44a-40ce-8d4f-1a20ca952db2-iptables-alerter-script\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-log-socket\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-config\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-daemon-config\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-log-socket\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-cni-binary-copy\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.841190 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx7r2\" (UniqueName: \"kubernetes.io/projected/e6814024-b109-497d-bc46-6e0eac94da99-kube-api-access-jx7r2\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-systemd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-ovn\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9j97\" (UniqueName: \"kubernetes.io/projected/1e92259e-3325-4cd9-a758-35dc8276f036-kube-api-access-k9j97\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6b84\" (UniqueName: \"kubernetes.io/projected/119bbf88-fdb1-4fca-ade3-77a093f94d26-kube-api-access-w6b84\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a605a4f-fdab-496a-a599-e49eed4f3a1c-hosts-file\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-multus-certs\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-agent-certs\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-slash\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-system-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-bin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-kubelet\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-device-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.842069 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.840993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-kubelet-config\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-modprobe-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-systemd\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovnkube-config\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-daemon-config\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-cnibin\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-cnibin\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-run\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-slash\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-run\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-kubelet\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq7h9\" (UniqueName: \"kubernetes.io/projected/dca48459-5605-4104-aea6-312dec5aa79b-kube-api-access-sq7h9\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-run-ovn\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-netns\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-system-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.842660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-kubernetes\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.841612 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlh49\" (UniqueName: \"kubernetes.io/projected/a4d15ffe-a70c-4251-9109-15471c53c56f-kube-api-access-qlh49\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52e85a9e-ea75-424e-89c3-9a7853635c86-host\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-netns\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841519 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-kubernetes\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-multus-cni-dir\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-var-lib-cni-bin\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.841714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:12:34.341674572 +0000 UTC m=+3.004411225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841343 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-modprobe-d\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-kubelet\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52e85a9e-ea75-424e-89c3-9a7853635c86-host\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119bbf88-fdb1-4fca-ade3-77a093f94d26-host-run-multus-certs\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-netns\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-system-cni-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.843231 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-kubelet\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-registration-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-host-run-netns\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a605a4f-fdab-496a-a599-e49eed4f3a1c-tmp-dir\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e92259e-3325-4cd9-a758-35dc8276f036-system-cni-dir\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-systemd-units\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-env-overrides\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841971 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-systemd-units\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.841969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.842003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-konnectivity-ca\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.842028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-conf\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.842176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dca48459-5605-4104-aea6-312dec5aa79b-etc-sysctl-conf\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.842288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-env-overrides\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.843774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.842586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e92259e-3325-4cd9-a758-35dc8276f036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.844232 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.843922 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-tmp\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.844232 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.844010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dca48459-5605-4104-aea6-312dec5aa79b-etc-tuned\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.844232 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.844140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-ovn-node-metrics-cert\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.848534 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.848516 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:33.848632 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.848539 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:33.848632 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.848552 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:33.848632 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.848623 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:34.348605648 +0000 UTC m=+3.011342303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:33.850844 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.850818 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6b84\" (UniqueName: \"kubernetes.io/projected/119bbf88-fdb1-4fca-ade3-77a093f94d26-kube-api-access-w6b84\") pod \"multus-hhkcx\" (UID: \"119bbf88-fdb1-4fca-ade3-77a093f94d26\") " pod="openshift-multus/multus-hhkcx" Aug 05 17:12:33.851391 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.851370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncns\" (UniqueName: \"kubernetes.io/projected/52e85a9e-ea75-424e-89c3-9a7853635c86-kube-api-access-rncns\") pod \"node-ca-49sdz\" (UID: \"52e85a9e-ea75-424e-89c3-9a7853635c86\") " pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:33.851498 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.851393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9j97\" (UniqueName: \"kubernetes.io/projected/1e92259e-3325-4cd9-a758-35dc8276f036-kube-api-access-k9j97\") pod \"multus-additional-cni-plugins-b4tlz\" (UID: \"1e92259e-3325-4cd9-a758-35dc8276f036\") " pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:33.851656 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.851637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq7h9\" (UniqueName: \"kubernetes.io/projected/dca48459-5605-4104-aea6-312dec5aa79b-kube-api-access-sq7h9\") pod \"tuned-x8s2w\" (UID: \"dca48459-5605-4104-aea6-312dec5aa79b\") " pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:33.851698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.851644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shr7f\" (UniqueName: \"kubernetes.io/projected/ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145-kube-api-access-shr7f\") pod \"ovnkube-node-x55zr\" (UID: \"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145\") " pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:33.852236 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.852219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlh49\" (UniqueName: \"kubernetes.io/projected/a4d15ffe-a70c-4251-9109-15471c53c56f-kube-api-access-qlh49\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:33.907011 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.906947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" event={"ID":"a04f0d69322552c16be42899defc244b","Type":"ContainerStarted","Data":"2ba5a43123edb9faf0acc9819b7d47481b03dfa64891e1a631bf7c7cf9e544fe"} Aug 05 17:12:33.908229 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.908195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"e9354fc9681ea7b93947172651a4c1e2","Type":"ContainerStarted","Data":"65619e8479d3d706eb312a7eb3629a6ef2cfcba32e3fa60171a1aeb56bedbcf2"} Aug 05 17:12:33.943201 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-dbus\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.943201 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4911667-a44a-40ce-8d4f-1a20ca952db2-host-slash\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rt9\" (UniqueName: \"kubernetes.io/projected/f4911667-a44a-40ce-8d4f-1a20ca952db2-kube-api-access-h2rt9\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4911667-a44a-40ce-8d4f-1a20ca952db2-iptables-alerter-script\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx7r2\" (UniqueName: \"kubernetes.io/projected/e6814024-b109-497d-bc46-6e0eac94da99-kube-api-access-jx7r2\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a605a4f-fdab-496a-a599-e49eed4f3a1c-hosts-file\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-agent-certs\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-device-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-kubelet-config\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.943468 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-registration-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-dbus\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943512 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4911667-a44a-40ce-8d4f-1a20ca952db2-host-slash\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a605a4f-fdab-496a-a599-e49eed4f3a1c-hosts-file\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-registration-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a605a4f-fdab-496a-a599-e49eed4f3a1c-tmp-dir\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-konnectivity-ca\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-socket-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-sys-fs\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dr2\" (UniqueName: \"kubernetes.io/projected/1a605a4f-fdab-496a-a599-e49eed4f3a1c-kube-api-access-r7dr2\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.943855 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a605a4f-fdab-496a-a599-e49eed4f3a1c-tmp-dir\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.943885 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.943912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-device-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:33.943945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:34.443925583 +0000 UTC m=+3.106662238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.944010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-socket-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.944058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-sys-fs\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.944081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6814024-b109-497d-bc46-6e0eac94da99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.944531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.944123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8721ab10-ae72-4e9b-bf8d-98adbe647c61-kubelet-config\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:33.944866 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.944663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-konnectivity-ca\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.945250 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.945225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4911667-a44a-40ce-8d4f-1a20ca952db2-iptables-alerter-script\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.946578 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.946558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee13a0c5-539c-4c8b-a8c6-8fc408e85e66-agent-certs\") pod \"konnectivity-agent-np6sw\" (UID: \"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66\") " pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:33.955496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.955469 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx7r2\" (UniqueName: \"kubernetes.io/projected/e6814024-b109-497d-bc46-6e0eac94da99-kube-api-access-jx7r2\") pod \"aws-ebs-csi-driver-node-hj8z2\" (UID: \"e6814024-b109-497d-bc46-6e0eac94da99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:33.955615 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.955528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rt9\" (UniqueName: \"kubernetes.io/projected/f4911667-a44a-40ce-8d4f-1a20ca952db2-kube-api-access-h2rt9\") pod \"iptables-alerter-4xhrh\" (UID: \"f4911667-a44a-40ce-8d4f-1a20ca952db2\") " pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:33.956066 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:33.956039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dr2\" (UniqueName: \"kubernetes.io/projected/1a605a4f-fdab-496a-a599-e49eed4f3a1c-kube-api-access-r7dr2\") pod \"node-resolver-t29x8\" (UID: \"1a605a4f-fdab-496a-a599-e49eed4f3a1c\") " pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:34.032711 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.032595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" Aug 05 17:12:34.038639 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.038590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49sdz" Aug 05 17:12:34.042928 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.042877 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca48459_5605_4104_aea6_312dec5aa79b.slice/crio-761bbcbf57c54972e41f2b66e951862a2d87d6b2aedb9e8dc2ad265f973c2417 WatchSource:0}: Error finding container 761bbcbf57c54972e41f2b66e951862a2d87d6b2aedb9e8dc2ad265f973c2417: Status 404 returned error can't find the container with id 761bbcbf57c54972e41f2b66e951862a2d87d6b2aedb9e8dc2ad265f973c2417 Aug 05 17:12:34.044599 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.044573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" Aug 05 17:12:34.049460 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.049429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhkcx" Aug 05 17:12:34.049840 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.049816 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e85a9e_ea75_424e_89c3_9a7853635c86.slice/crio-6dfc7ad1d134acd7f4b89e1731e283fa2efeac4980de775530475ca9c45bb39f WatchSource:0}: Error finding container 6dfc7ad1d134acd7f4b89e1731e283fa2efeac4980de775530475ca9c45bb39f: Status 404 returned error can't find the container with id 6dfc7ad1d134acd7f4b89e1731e283fa2efeac4980de775530475ca9c45bb39f Aug 05 17:12:34.055097 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.055075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:34.056342 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.056314 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e92259e_3325_4cd9_a758_35dc8276f036.slice/crio-7d8ca1ae70fa9a3a826bfdfc6f8dd6958abe00f406607162e8b21dfa3851b60d WatchSource:0}: Error finding container 7d8ca1ae70fa9a3a826bfdfc6f8dd6958abe00f406607162e8b21dfa3851b60d: Status 404 returned error can't find the container with id 7d8ca1ae70fa9a3a826bfdfc6f8dd6958abe00f406607162e8b21dfa3851b60d Aug 05 17:12:34.059958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.059941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:34.060299 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.060252 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119bbf88_fdb1_4fca_ade3_77a093f94d26.slice/crio-26bc3ab2bc5d04649c716d68660af474dd2ea2e191b11108e7cb525b2276f0af WatchSource:0}: Error finding container 26bc3ab2bc5d04649c716d68660af474dd2ea2e191b11108e7cb525b2276f0af: Status 404 returned error can't find the container with id 26bc3ab2bc5d04649c716d68660af474dd2ea2e191b11108e7cb525b2276f0af Aug 05 17:12:34.065912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.065583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" Aug 05 17:12:34.066542 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.066513 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebed45c0_9d7b_4e1c_a3fb_44f6e43ed145.slice/crio-9404075a08495e4e5efc2e59beb9548353b2d665ee09e7cffe62eb9c07686b9c WatchSource:0}: Error finding container 9404075a08495e4e5efc2e59beb9548353b2d665ee09e7cffe62eb9c07686b9c: Status 404 returned error can't find the container with id 9404075a08495e4e5efc2e59beb9548353b2d665ee09e7cffe62eb9c07686b9c Aug 05 17:12:34.072704 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.072559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xhrh" Aug 05 17:12:34.075535 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.075506 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee13a0c5_539c_4c8b_a8c6_8fc408e85e66.slice/crio-160252b704cfacf438cdf5d0c5c300efc420320626898a93df265e0f5635e0c4 WatchSource:0}: Error finding container 160252b704cfacf438cdf5d0c5c300efc420320626898a93df265e0f5635e0c4: Status 404 returned error can't find the container with id 160252b704cfacf438cdf5d0c5c300efc420320626898a93df265e0f5635e0c4 Aug 05 17:12:34.077321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.077142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t29x8" Aug 05 17:12:34.079882 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.079340 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6814024_b109_497d_bc46_6e0eac94da99.slice/crio-2325f7df1a2af3f7378c5ab754fc4229ceeef13ae3a27bf64da7a130811c4b11 WatchSource:0}: Error finding container 2325f7df1a2af3f7378c5ab754fc4229ceeef13ae3a27bf64da7a130811c4b11: Status 404 returned error can't find the container with id 2325f7df1a2af3f7378c5ab754fc4229ceeef13ae3a27bf64da7a130811c4b11 Aug 05 17:12:34.084057 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.084031 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4911667_a44a_40ce_8d4f_1a20ca952db2.slice/crio-2ef74d3e7550d42f809d23e1c72d4ee27d6da2b9e41614a0a744d86bd639af01 WatchSource:0}: Error finding container 2ef74d3e7550d42f809d23e1c72d4ee27d6da2b9e41614a0a744d86bd639af01: Status 404 returned error can't find the container with id 2ef74d3e7550d42f809d23e1c72d4ee27d6da2b9e41614a0a744d86bd639af01 Aug 05 17:12:34.089335 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:12:34.089310 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a605a4f_fdab_496a_a599_e49eed4f3a1c.slice/crio-94e7633df194b6d7856bd961ddd05c1371e934a453caf38babb55a2ac8e3cc39 WatchSource:0}: Error finding container 94e7633df194b6d7856bd961ddd05c1371e934a453caf38babb55a2ac8e3cc39: Status 404 returned error can't find the container with id 94e7633df194b6d7856bd961ddd05c1371e934a453caf38babb55a2ac8e3cc39 Aug 05 17:12:34.346858 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.346784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:34.347016 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.346924 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:34.347016 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.346991 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:12:35.346974317 +0000 UTC m=+4.009710957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:34.447385 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.447357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:34.447573 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.447425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:34.447573 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447536 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:34.447573 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447547 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:34.447573 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447572 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:34.447821 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447586 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:34.447821 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:35.447584373 +0000 UTC m=+4.110321014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:34.447821 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.447636 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:35.447620674 +0000 UTC m=+4.110357314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:34.785590 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.785429 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:33 +0000 UTC" deadline="2028-04-12 07:58:50.597627384 +0000 UTC" Aug 05 17:12:34.785590 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.785545 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14774h46m15.812095606s" Aug 05 17:12:34.901199 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.901161 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:34.901370 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:34.901318 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:34.911708 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.911650 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-np6sw" event={"ID":"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66","Type":"ContainerStarted","Data":"160252b704cfacf438cdf5d0c5c300efc420320626898a93df265e0f5635e0c4"} Aug 05 17:12:34.913551 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.913515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"9404075a08495e4e5efc2e59beb9548353b2d665ee09e7cffe62eb9c07686b9c"} Aug 05 17:12:34.914899 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.914842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xhrh" event={"ID":"f4911667-a44a-40ce-8d4f-1a20ca952db2","Type":"ContainerStarted","Data":"2ef74d3e7550d42f809d23e1c72d4ee27d6da2b9e41614a0a744d86bd639af01"} Aug 05 17:12:34.916241 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.916220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" event={"ID":"e6814024-b109-497d-bc46-6e0eac94da99","Type":"ContainerStarted","Data":"2325f7df1a2af3f7378c5ab754fc4229ceeef13ae3a27bf64da7a130811c4b11"} Aug 05 17:12:34.917554 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.917510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhkcx" event={"ID":"119bbf88-fdb1-4fca-ade3-77a093f94d26","Type":"ContainerStarted","Data":"26bc3ab2bc5d04649c716d68660af474dd2ea2e191b11108e7cb525b2276f0af"} Aug 05 17:12:34.919025 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.918789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerStarted","Data":"7d8ca1ae70fa9a3a826bfdfc6f8dd6958abe00f406607162e8b21dfa3851b60d"} Aug 05 17:12:34.920150 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.920107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49sdz" event={"ID":"52e85a9e-ea75-424e-89c3-9a7853635c86","Type":"ContainerStarted","Data":"6dfc7ad1d134acd7f4b89e1731e283fa2efeac4980de775530475ca9c45bb39f"} Aug 05 17:12:34.921336 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.921291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" event={"ID":"dca48459-5605-4104-aea6-312dec5aa79b","Type":"ContainerStarted","Data":"761bbcbf57c54972e41f2b66e951862a2d87d6b2aedb9e8dc2ad265f973c2417"} Aug 05 17:12:34.922537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:34.922505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t29x8" event={"ID":"1a605a4f-fdab-496a-a599-e49eed4f3a1c","Type":"ContainerStarted","Data":"94e7633df194b6d7856bd961ddd05c1371e934a453caf38babb55a2ac8e3cc39"} Aug 05 17:12:35.355289 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.355253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:35.355484 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.355402 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:35.355484 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.355480 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:12:37.355460683 +0000 UTC m=+6.018197334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:35.456625 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.456538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:35.456625 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.456605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456723 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456740 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456750 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456763 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456798 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:37.456779561 +0000 UTC m=+6.119516215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:35.456832 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.456818 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:37.456808242 +0000 UTC m=+6.119544885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:35.583872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.583665 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:35.786250 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.786191 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:33 +0000 UTC" deadline="2028-01-30 15:01:44.42233605 +0000 UTC" Aug 05 17:12:35.786250 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.786250 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13029h49m8.636089194s" Aug 05 17:12:35.905667 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.904335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:35.905667 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.904729 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:35.905667 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:35.905169 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:35.905667 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:35.905340 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:36.901803 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:36.901768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:36.902267 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:36.901906 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:36.943494 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:36.942908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" event={"ID":"a04f0d69322552c16be42899defc244b","Type":"ContainerStarted","Data":"b9fc64cb9038d6b725c6be634bbaa1c167ffd4e95c413284ae459856d0e013b9"} Aug 05 17:12:36.955520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:36.955488 2579 generic.go:356] "Generic (PLEG): container finished" podID="e9354fc9681ea7b93947172651a4c1e2" containerID="54fec292caf68cf1f727f8088457a282f652694bc5295e9dbad37d9233adeca0" exitCode=0 Aug 05 17:12:36.955723 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:36.955541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"e9354fc9681ea7b93947172651a4c1e2","Type":"ContainerDied","Data":"54fec292caf68cf1f727f8088457a282f652694bc5295e9dbad37d9233adeca0"} Aug 05 17:12:36.958606 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:36.958554 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" podStartSLOduration=3.958524611 podStartE2EDuration="3.958524611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:36.958016952 +0000 UTC m=+5.620753611" watchObservedRunningTime="2026-08-05 17:12:36.958524611 +0000 UTC m=+5.621261272" Aug 05 17:12:37.372731 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:37.372690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:37.372926 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.372897 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:37.372988 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.372959 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:12:41.372939585 +0000 UTC m=+10.035676241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:37.473473 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:37.473436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:37.473637 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:37.473503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:37.473700 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.473653 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:37.473773 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.473714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:41.473696364 +0000 UTC m=+10.136433020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:37.474149 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.474128 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:37.474233 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.474154 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:37.474233 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.474168 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:37.474233 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.474213 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:41.474197139 +0000 UTC m=+10.136933782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:37.903196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:37.902563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:37.903196 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.902736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:37.903984 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:37.903804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:37.903984 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:37.903912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:38.902012 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:38.901978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:38.902195 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:38.902120 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:39.901585 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:39.901403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:39.901585 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:39.901562 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:39.902089 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:39.901695 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:39.902089 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:39.901787 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:40.901490 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:40.901457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:40.901652 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:40.901584 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:41.405031 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:41.404992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:41.405216 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.405132 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:41.405216 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.405201 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.405179243 +0000 UTC m=+18.067915886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:41.505354 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:41.505315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:41.505525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:41.505382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:41.505599 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.505564 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:41.505657 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.505635 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.505614603 +0000 UTC m=+18.168351244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:41.506170 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.506056 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:41.506170 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.506078 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:41.506170 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.506091 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:41.506170 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.506137 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.50612149 +0000 UTC m=+18.168858130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:41.902735 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:41.902694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:41.902735 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:41.902719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:41.903251 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.902899 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:41.903251 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:41.903026 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:42.902035 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:42.902001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:42.902253 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:42.902136 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:43.901168 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:43.901136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:43.901168 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:43.901137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:43.901703 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:43.901282 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:43.901784 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:43.901748 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:44.901574 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:44.901542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:44.901972 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:44.901660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:45.901156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:45.901119 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:45.901351 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:45.901276 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:45.901351 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:45.901299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:45.901487 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:45.901423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:46.901131 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:46.901089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:46.901644 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:46.901217 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:47.901797 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:47.901755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:47.902252 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:47.901755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:47.902252 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:47.901893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:47.902252 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:47.901984 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:48.901456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:48.901404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:48.901682 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:48.901533 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:49.465891 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:49.465852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:49.466396 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.466007 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:49.466396 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.466088 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:13:05.466071048 +0000 UTC m=+34.128807685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:49.566711 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:49.566669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:49.566900 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:49.566723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:49.566900 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566852 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:49.566900 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566857 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:49.566900 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566889 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:49.566900 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566902 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:49.567183 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566927 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:05.566905818 +0000 UTC m=+34.229642460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:49.567183 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.566954 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:05.566937435 +0000 UTC m=+34.229674094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:49.901254 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:49.901223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:49.901472 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.901363 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:49.901472 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:49.901437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:49.901594 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:49.901546 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:50.901993 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:50.901958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:50.902439 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:50.902068 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:51.902527 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:51.902488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:51.903000 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:51.902630 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:51.903000 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:51.902685 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:51.903000 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:51.902805 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:52.901988 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:52.901965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:52.902084 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:52.902067 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:53.902389 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.902094 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:53.903039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.902163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:53.903039 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:53.902511 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:53.903039 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:53.902565 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:53.994914 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.994846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:12:53.995301 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995272 2579 generic.go:356] "Generic (PLEG): container finished" podID="ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145" containerID="dc9da03adcd5a3ce8c8f526553c826f55241989cf35833e1a6ee120d861bebaf" exitCode=1 Aug 05 17:12:53.995402 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"d3c6e8add8863281cbafb01219dbf01c81a4f82894407b4b8f5adf0e6e17a565"} Aug 05 17:12:53.995402 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"ffc2017c83cfe5d98cde8757019739ae30fd24e977cb1ccbc8251ad45801c361"} Aug 05 17:12:53.995537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"ed937516c1ad967c8795a0023b0dd0ee556f4adb42a909227e0a3cd9cb990978"} Aug 05 17:12:53.995537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"367f7bd1345f816ad36b44b135cf01bd4fcf91729027e64f3e41293d692b96dd"} Aug 05 17:12:53.995638 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerDied","Data":"dc9da03adcd5a3ce8c8f526553c826f55241989cf35833e1a6ee120d861bebaf"} Aug 05 17:12:53.995638 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.995595 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"ba2256514c301413e9fe03b2eda070bbf514c3fc73f2e7e6db5f7e03e4973225"} Aug 05 17:12:53.997524 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.997502 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"e9354fc9681ea7b93947172651a4c1e2","Type":"ContainerStarted","Data":"90e1d5ae32f2ee4fca27ec9992abcb14d2fdbd8153bce7fa3e7b73122470aff1"} Aug 05 17:12:53.999459 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:53.999437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" event={"ID":"e6814024-b109-497d-bc46-6e0eac94da99","Type":"ContainerStarted","Data":"6e13146bc265dd103bfddd5c9d47e387da923a5f5d97f9c53934d482f000c5b5"} Aug 05 17:12:54.001084 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.001063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhkcx" event={"ID":"119bbf88-fdb1-4fca-ade3-77a093f94d26","Type":"ContainerStarted","Data":"d90c91d5593ae6301dea81d249be885abdd4eb2e0d645bae7709692676d8f25a"} Aug 05 17:12:54.002828 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.002804 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="316c6d5f3d59c2da1a10c8d40940a345ff88de30b2ac1babe6766afdc9df61a6" exitCode=0 Aug 05 17:12:54.002938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.002839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"316c6d5f3d59c2da1a10c8d40940a345ff88de30b2ac1babe6766afdc9df61a6"} Aug 05 17:12:54.004939 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.004915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49sdz" event={"ID":"52e85a9e-ea75-424e-89c3-9a7853635c86","Type":"ContainerStarted","Data":"b98a632cae278919cb9d4b6410c79f10b6685e2d1e39fbfb040d85fd3df8b478"} Aug 05 17:12:54.006634 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.006610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" event={"ID":"dca48459-5605-4104-aea6-312dec5aa79b","Type":"ContainerStarted","Data":"61c1625b9a43fad116bd33078c578e28be52287ec8b489181732fba9a4445b63"} Aug 05 17:12:54.008712 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.008688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t29x8" event={"ID":"1a605a4f-fdab-496a-a599-e49eed4f3a1c","Type":"ContainerStarted","Data":"f52913067b332ea23759079a3578d304d6d117ada3f9ea0b6e55db8dccc3da74"} Aug 05 17:12:54.010714 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.010695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-np6sw" event={"ID":"ee13a0c5-539c-4c8b-a8c6-8fc408e85e66","Type":"ContainerStarted","Data":"70d42d53b8ca96f3b22082564da4d6db94eb30684c3f2c771e06236b07517b85"} Aug 05 17:12:54.015774 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.015736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" podStartSLOduration=21.015721599 podStartE2EDuration="21.015721599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.015600909 +0000 UTC m=+22.678337570" watchObservedRunningTime="2026-08-05 17:12:54.015721599 +0000 UTC m=+22.678458260" Aug 05 17:12:54.033616 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.033576 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-np6sw" podStartSLOduration=4.213575758 podStartE2EDuration="23.033563064s" totalImagesPullingTime="18.819987306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.033282566 +0000 UTC m=+22.696019227" watchObservedRunningTime="2026-08-05 17:12:54.033563064 +0000 UTC m=+22.696299723" Aug 05 17:12:54.072934 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.072879 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t29x8" podStartSLOduration=3.243538403 podStartE2EDuration="22.072858254s" totalImagesPullingTime="18.829319851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.04815661 +0000 UTC m=+22.710893273" watchObservedRunningTime="2026-08-05 17:12:54.072858254 +0000 UTC m=+22.735594915" Aug 05 17:12:54.108683 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.108642 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x8s2w" podStartSLOduration=4.236365324 podStartE2EDuration="23.108625961s" totalImagesPullingTime="18.872260637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.088232145 +0000 UTC m=+22.750968806" watchObservedRunningTime="2026-08-05 17:12:54.108625961 +0000 UTC m=+22.771362621" Aug 05 17:12:54.108836 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.108727 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-49sdz" podStartSLOduration=4.242635521 podStartE2EDuration="23.108723742s" totalImagesPullingTime="18.866088221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.108498389 +0000 UTC m=+22.771235050" watchObservedRunningTime="2026-08-05 17:12:54.108723742 +0000 UTC m=+22.771460402" Aug 05 17:12:54.786638 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.786610 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 17:12:54.794184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.794109 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:12:54.78663548Z","UUID":"1a565fc6-426d-4343-8a0d-aa6141c77763","Handler":null,"Name":"","Endpoint":""} Aug 05 17:12:54.795550 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.795532 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 17:12:54.795625 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.795568 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 17:12:54.901485 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:54.901449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:54.901638 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:54.901555 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:55.014620 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.014541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xhrh" event={"ID":"f4911667-a44a-40ce-8d4f-1a20ca952db2","Type":"ContainerStarted","Data":"140938b60f9ab0fc33e7af1190259d7ba72af2445e19199934c402d9b739f610"} Aug 05 17:12:55.016941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.016916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" event={"ID":"e6814024-b109-497d-bc46-6e0eac94da99","Type":"ContainerStarted","Data":"529a20e5d930a8b6d509325e61452abc34e9a1b8fdd4e61690bbcc31a74945a2"} Aug 05 17:12:55.036178 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.036137 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4xhrh" podStartSLOduration=4.204484376 podStartE2EDuration="23.036123404s" totalImagesPullingTime="18.831639028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:55.03563059 +0000 UTC m=+23.698367252" watchObservedRunningTime="2026-08-05 17:12:55.036123404 +0000 UTC m=+23.698860064" Aug 05 17:12:55.036519 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.036478 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hhkcx" podStartSLOduration=5.166150423 podStartE2EDuration="24.036469738s" totalImagesPullingTime="18.870319315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:54.129210831 +0000 UTC m=+22.791947491" watchObservedRunningTime="2026-08-05 17:12:55.036469738 +0000 UTC m=+23.699206397" Aug 05 17:12:55.488495 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.488459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:55.489075 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.489034 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:12:55.901662 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.901633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:55.901822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:55.901632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:55.901822 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:55.901774 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:55.901901 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:55.901834 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:56.901904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:56.901714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:56.902397 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:56.902000 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:57.025896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.025860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" event={"ID":"e6814024-b109-497d-bc46-6e0eac94da99","Type":"ContainerStarted","Data":"ddd37b22e32de47f0974e85a70ee3b867af5e49a1955ad06fa9c2eb27ba91da4"} Aug 05 17:12:57.029006 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.028984 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:12:57.029333 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.029318 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 05 17:12:57.029429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.029329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"f2c565734901ad4bd2bfb2aecf78ce86f7928a48b8befda26e6f96d492bb8027"} Aug 05 17:12:57.047579 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.047530 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj8z2" podStartSLOduration=4.554485432 podStartE2EDuration="26.047515157s" totalImagesPullingTime="21.493029725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:57.047045322 +0000 UTC m=+25.709781981" watchObservedRunningTime="2026-08-05 17:12:57.047515157 +0000 UTC m=+25.710251861" Aug 05 17:12:57.901531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.901494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:57.901725 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:57.901655 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:57.901795 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:57.901718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:57.901855 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:57.901835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:12:58.901854 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:58.901590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:12:58.902506 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:58.901886 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:12:59.036821 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.036797 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:12:59.037173 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.037147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"23598e32a0ae16b40d6cddf8b0e50c065f29892be9ca9e940c133d6fcb30072e"} Aug 05 17:12:59.037399 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.037375 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:59.037564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.037538 2579 scope.go:117] "RemoveContainer" containerID="dc9da03adcd5a3ce8c8f526553c826f55241989cf35833e1a6ee120d861bebaf" Aug 05 17:12:59.039114 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.039090 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="e3cb3a242f36cac471bbaa97a77eb9862020c4d9b7f84627eca919887fbbb7aa" exitCode=0 Aug 05 17:12:59.039222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.039121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"e3cb3a242f36cac471bbaa97a77eb9862020c4d9b7f84627eca919887fbbb7aa"} Aug 05 17:12:59.054357 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.054333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:12:59.901842 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.901770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:12:59.902018 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:59.901897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:12:59.902018 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:12:59.901963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:12:59.902392 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:12:59.902076 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:13:00.048698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.048667 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:13:00.049254 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.049217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" event={"ID":"ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145","Type":"ContainerStarted","Data":"69eac37be2f81e2efee10444546ea7248720ebc2bf7e62fc67d826f55b18211f"} Aug 05 17:13:00.049796 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.049774 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:13:00.049924 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.049851 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:13:00.073593 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.073559 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:13:00.080454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.080384 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" podStartSLOduration=9.819648547 podStartE2EDuration="29.080369086s" totalImagesPullingTime="19.260720539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:00.079178158 +0000 UTC m=+28.741914842" watchObservedRunningTime="2026-08-05 17:13:00.080369086 +0000 UTC m=+28.743105745" Aug 05 17:13:00.901568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:00.901536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:00.901734 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:00.901644 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:13:01.054582 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.054297 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="a46c683a5e7277c4211cd29eb79e16733726f9186abdd652e6e47f090b736275" exitCode=0 Aug 05 17:13:01.055003 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.054381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"a46c683a5e7277c4211cd29eb79e16733726f9186abdd652e6e47f090b736275"} Aug 05 17:13:01.085631 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.085593 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpbtn"] Aug 05 17:13:01.085883 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.085781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:01.085945 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:01.085908 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:13:01.086607 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.086585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgnlr"] Aug 05 17:13:01.086734 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.086719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:01.086865 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:01.086830 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:13:01.087121 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.087099 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zxv4c"] Aug 05 17:13:01.087203 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:01.087190 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:01.087292 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:01.087275 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:13:02.267543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.267511 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:13:02.268020 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.267656 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 05 17:13:02.268278 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.268255 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-np6sw" Aug 05 17:13:02.901884 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.901802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:02.901884 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.901828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:02.902056 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:02.901920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:13:02.902056 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:02.901961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:13:02.902056 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:02.901967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:02.902056 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:02.902021 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:13:03.060500 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:03.060466 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="58b0d3b2c28d9e48ce82171c04f510bf7f56aae04ee31266c1896f0e34d0ca66" exitCode=0 Aug 05 17:13:03.060634 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:03.060552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"58b0d3b2c28d9e48ce82171c04f510bf7f56aae04ee31266c1896f0e34d0ca66"} Aug 05 17:13:04.850867 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:04.850823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np6sw_ee13a0c5-539c-4c8b-a8c6-8fc408e85e66/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:04.901868 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:04.901829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:04.902050 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:04.901836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:04.902050 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:04.901946 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgnlr" podUID="99af7d6a-5724-49c5-a87e-06c955ea8867" Aug 05 17:13:04.902050 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:04.901974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:04.902173 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:04.902084 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:13:04.902215 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:04.902170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zxv4c" podUID="8721ab10-ae72-4e9b-bf8d-98adbe647c61" Aug 05 17:13:04.955423 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:04.955385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np6sw_ee13a0c5-539c-4c8b-a8c6-8fc408e85e66/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:05.484768 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.484722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:05.484945 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.484879 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:13:05.484999 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.484951 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:13:37.484930544 +0000 UTC m=+66.147667187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:13:05.585559 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.585521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:05.585704 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.585590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:05.585762 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585717 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:13:05.585811 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585778 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret podName:8721ab10-ae72-4e9b-bf8d-98adbe647c61 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:37.585762017 +0000 UTC m=+66.248498655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret") pod "global-pull-secret-syncer-zxv4c" (UID: "8721ab10-ae72-4e9b-bf8d-98adbe647c61") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:13:05.585811 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585719 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:13:05.585928 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585830 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:13:05.585928 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585845 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m2gtx for pod openshift-network-diagnostics/network-check-target-fgnlr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:13:05.585928 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.585895 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx podName:99af7d6a-5724-49c5-a87e-06c955ea8867 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:37.585882787 +0000 UTC m=+66.248619441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2gtx" (UniqueName: "kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx") pod "network-check-target-fgnlr" (UID: "99af7d6a-5724-49c5-a87e-06c955ea8867") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:13:05.629476 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.629441 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeReady" Aug 05 17:13:05.629657 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.629605 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 17:13:05.696605 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.696569 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghsgr"] Aug 05 17:13:05.699658 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.699631 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.700676 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.700651 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pbvdz"] Aug 05 17:13:05.702284 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.702057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 17:13:05.702423 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.702333 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qzqd\"" Aug 05 17:13:05.702531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.702502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.702588 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.702564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 17:13:05.702921 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.702903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 17:13:05.708853 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.708831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 17:13:05.708967 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.708902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hnrl\"" Aug 05 17:13:05.709011 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.708836 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 17:13:05.712140 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.712117 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghsgr"] Aug 05 17:13:05.715274 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.715248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pbvdz"] Aug 05 17:13:05.787005 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.786969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1077d4-d334-4841-8320-79b660e24365-config-volume\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.787187 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.787048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4a119f-cdbd-4d92-801b-dcaec9911afd-cert\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.787187 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.787122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.787303 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.787188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1077d4-d334-4841-8320-79b660e24365-tmp-dir\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.787303 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.787211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxk6\" (UniqueName: \"kubernetes.io/projected/fd1077d4-d334-4841-8320-79b660e24365-kube-api-access-8hxk6\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.787303 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.787228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xqb\" (UniqueName: \"kubernetes.io/projected/da4a119f-cdbd-4d92-801b-dcaec9911afd-kube-api-access-s5xqb\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.860319 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.860275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-np6sw_ee13a0c5-539c-4c8b-a8c6-8fc408e85e66/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:05.888370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1077d4-d334-4841-8320-79b660e24365-config-volume\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.888547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4a119f-cdbd-4d92-801b-dcaec9911afd-cert\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.888547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.888668 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.888559 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:05.888668 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1077d4-d334-4841-8320-79b660e24365-tmp-dir\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.888668 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxk6\" (UniqueName: \"kubernetes.io/projected/fd1077d4-d334-4841-8320-79b660e24365-kube-api-access-8hxk6\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.888668 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:05.888635 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:06.388613128 +0000 UTC m=+35.051349781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:05.888859 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xqb\" (UniqueName: \"kubernetes.io/projected/da4a119f-cdbd-4d92-801b-dcaec9911afd-kube-api-access-s5xqb\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.888995 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.888976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1077d4-d334-4841-8320-79b660e24365-config-volume\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.889227 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.889203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1077d4-d334-4841-8320-79b660e24365-tmp-dir\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.893956 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.893810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da4a119f-cdbd-4d92-801b-dcaec9911afd-cert\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:05.902904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.902865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxk6\" (UniqueName: \"kubernetes.io/projected/fd1077d4-d334-4841-8320-79b660e24365-kube-api-access-8hxk6\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:05.903336 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:05.903314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xqb\" (UniqueName: \"kubernetes.io/projected/da4a119f-cdbd-4d92-801b-dcaec9911afd-kube-api-access-s5xqb\") pod \"ingress-canary-ghsgr\" (UID: \"da4a119f-cdbd-4d92-801b-dcaec9911afd\") " pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:06.013183 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.013124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghsgr" Aug 05 17:13:06.391357 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.391315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:06.391566 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:06.391509 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:06.391630 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:06.391595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:07.391570959 +0000 UTC m=+36.054307619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:06.901927 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.901899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:06.901927 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.901928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:06.902361 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.901938 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:06.904424 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.904391 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:13:06.904996 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.904975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:13:06.905089 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.905018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wztxg\"" Aug 05 17:13:06.905089 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.905050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:13:06.905089 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.905059 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:13:06.905255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:06.905114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4hs5f\"" Aug 05 17:13:07.002769 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:07.002746 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghsgr"] Aug 05 17:13:07.007836 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:13:07.007811 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4a119f_cdbd_4d92_801b_dcaec9911afd.slice/crio-2bbfd76e7451a517ffccf5dee5a2a2e59a777e5414ebb9941f41ab8ebc602c26 WatchSource:0}: Error finding container 2bbfd76e7451a517ffccf5dee5a2a2e59a777e5414ebb9941f41ab8ebc602c26: Status 404 returned error can't find the container with id 2bbfd76e7451a517ffccf5dee5a2a2e59a777e5414ebb9941f41ab8ebc602c26 Aug 05 17:13:07.071067 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:07.071039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghsgr" event={"ID":"da4a119f-cdbd-4d92-801b-dcaec9911afd","Type":"ContainerStarted","Data":"2bbfd76e7451a517ffccf5dee5a2a2e59a777e5414ebb9941f41ab8ebc602c26"} Aug 05 17:13:07.399512 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:07.399441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:07.399635 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:07.399602 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:07.399670 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:07.399664 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:09.399649884 +0000 UTC m=+38.062386523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:08.076543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:08.076509 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="c4a1f84d65ebbdf4133c8dd01bc689015cfa75abc300e0e0333106ec42a683bd" exitCode=0 Aug 05 17:13:08.076944 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:08.076572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"c4a1f84d65ebbdf4133c8dd01bc689015cfa75abc300e0e0333106ec42a683bd"} Aug 05 17:13:09.082812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:09.082618 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e92259e-3325-4cd9-a758-35dc8276f036" containerID="c52cc66ac4ea140687f1e1453f0831807fb2cb71eca9fbdf4681d91c53f10105" exitCode=0 Aug 05 17:13:09.083227 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:09.082703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerDied","Data":"c52cc66ac4ea140687f1e1453f0831807fb2cb71eca9fbdf4681d91c53f10105"} Aug 05 17:13:09.414519 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:09.414490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:09.414672 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:09.414648 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:09.414726 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:09.414716 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:13.414701689 +0000 UTC m=+42.077438330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:10.088148 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:10.088104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" event={"ID":"1e92259e-3325-4cd9-a758-35dc8276f036","Type":"ContainerStarted","Data":"0427e2832af4872281ffd5b6b150457393d24edf6f4f1aebbb0a7fbbd90e794c"} Aug 05 17:13:10.089483 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:10.089460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghsgr" event={"ID":"da4a119f-cdbd-4d92-801b-dcaec9911afd","Type":"ContainerStarted","Data":"18ab5bd4552c177062a89730447f41627564924e8c7eda67b46a0dffb38c0b9d"} Aug 05 17:13:10.124883 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:10.124830 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b4tlz" podStartSLOduration=9.105202522 podStartE2EDuration="39.124813042s" totalImagesPullingTime="30.01961052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:10.124518485 +0000 UTC m=+38.787255166" watchObservedRunningTime="2026-08-05 17:13:10.124813042 +0000 UTC m=+38.787549710" Aug 05 17:13:10.148237 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:10.148190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghsgr" podStartSLOduration=2.792278562 podStartE2EDuration="5.148174165s" totalImagesPullingTime="2.355895603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:10.147755627 +0000 UTC m=+38.810492290" watchObservedRunningTime="2026-08-05 17:13:10.148174165 +0000 UTC m=+38.810910824" Aug 05 17:13:13.441978 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:13.441938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:13.442558 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:13.442056 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:13.442558 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:13.442110 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:21.442096399 +0000 UTC m=+50.104833036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:21.501705 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:21.501653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:21.502126 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:21.501806 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:21.502126 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:21.501875 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:37.501860074 +0000 UTC m=+66.164596713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:32.066390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:32.066362 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x55zr" Aug 05 17:13:37.506696 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.506663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:13:37.507079 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.506705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:13:37.507079 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:37.506823 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:37.507079 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:37.506877 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:09.506863 +0000 UTC m=+98.169599641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:13:37.511510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.511494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:13:37.517487 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:37.517470 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:13:37.517541 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:13:37.517522 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:14:41.5175078 +0000 UTC m=+130.180244438 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : secret "metrics-daemon-secret" not found Aug 05 17:13:37.607603 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.607572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:37.607741 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.607626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:37.610206 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.610190 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:13:37.610269 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.610254 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:13:37.620578 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.620557 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:13:37.621998 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.621981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8721ab10-ae72-4e9b-bf8d-98adbe647c61-original-pull-secret\") pod \"global-pull-secret-syncer-zxv4c\" (UID: \"8721ab10-ae72-4e9b-bf8d-98adbe647c61\") " pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:37.630953 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.630933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gtx\" (UniqueName: \"kubernetes.io/projected/99af7d6a-5724-49c5-a87e-06c955ea8867-kube-api-access-m2gtx\") pod \"network-check-target-fgnlr\" (UID: \"99af7d6a-5724-49c5-a87e-06c955ea8867\") " pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:37.823259 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.823227 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wztxg\"" Aug 05 17:13:37.828110 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.828092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zxv4c" Aug 05 17:13:37.831312 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.831290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:37.989519 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:37.989491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zxv4c"] Aug 05 17:13:38.004765 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:13:38.004740 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8721ab10_ae72_4e9b_bf8d_98adbe647c61.slice/crio-e23fc7209e35ce782ef9472359db32792a895359c05a3959fa325495a08790d0 WatchSource:0}: Error finding container e23fc7209e35ce782ef9472359db32792a895359c05a3959fa325495a08790d0: Status 404 returned error can't find the container with id e23fc7209e35ce782ef9472359db32792a895359c05a3959fa325495a08790d0 Aug 05 17:13:38.010258 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:38.010232 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgnlr"] Aug 05 17:13:38.012669 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:13:38.012647 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99af7d6a_5724_49c5_a87e_06c955ea8867.slice/crio-a0645572a691f361faec3c0f3560711202098174f1f92d9062240a9123d5e1f8 WatchSource:0}: Error finding container a0645572a691f361faec3c0f3560711202098174f1f92d9062240a9123d5e1f8: Status 404 returned error can't find the container with id a0645572a691f361faec3c0f3560711202098174f1f92d9062240a9123d5e1f8 Aug 05 17:13:38.153500 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:38.153404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgnlr" event={"ID":"99af7d6a-5724-49c5-a87e-06c955ea8867","Type":"ContainerStarted","Data":"a0645572a691f361faec3c0f3560711202098174f1f92d9062240a9123d5e1f8"} Aug 05 17:13:38.154378 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:38.154356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zxv4c" event={"ID":"8721ab10-ae72-4e9b-bf8d-98adbe647c61","Type":"ContainerStarted","Data":"e23fc7209e35ce782ef9472359db32792a895359c05a3959fa325495a08790d0"} Aug 05 17:13:43.170067 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:43.170027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgnlr" event={"ID":"99af7d6a-5724-49c5-a87e-06c955ea8867","Type":"ContainerStarted","Data":"4fab9f89245444c1b112ef4d590e88baf111685472401bedba7f07abc204d9cc"} Aug 05 17:13:43.170553 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:43.170098 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:13:43.171465 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:43.171437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zxv4c" event={"ID":"8721ab10-ae72-4e9b-bf8d-98adbe647c61","Type":"ContainerStarted","Data":"ec94212323061f67488b09410e4f1d9fb4bb012d6d112e10f2e0aa8ece2bd346"} Aug 05 17:13:43.197279 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:13:43.197229 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fgnlr" podStartSLOduration=67.894166542 podStartE2EDuration="1m12.197215284s" totalImagesPullingTime="4.303048742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:43.192556578 +0000 UTC m=+71.855293231" watchObservedRunningTime="2026-08-05 17:13:43.197215284 +0000 UTC m=+71.859951941" Aug 05 17:14:09.531693 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:09.531579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:14:09.532130 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:09.531743 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:14:09.532130 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:09.531836 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls podName:fd1077d4-d334-4841-8320-79b660e24365 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:13.531815828 +0000 UTC m=+162.194552467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls") pod "dns-default-pbvdz" (UID: "fd1077d4-d334-4841-8320-79b660e24365") : secret "dns-default-metrics-tls" not found Aug 05 17:14:14.177144 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:14.177113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fgnlr" Aug 05 17:14:14.195362 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:14.195308 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zxv4c" podStartSLOduration=97.881242237 podStartE2EDuration="1m42.195289194s" totalImagesPullingTime="4.314046957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:43.214494962 +0000 UTC m=+71.877231623" watchObservedRunningTime="2026-08-05 17:14:14.195289194 +0000 UTC m=+102.858025844" Aug 05 17:14:22.181697 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.181665 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-d2b2t"] Aug 05 17:14:22.183533 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.183516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.187140 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.187114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 17:14:22.187257 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.187114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 17:14:22.187778 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.187758 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 05 17:14:22.187854 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.187799 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 05 17:14:22.187904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.187861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5vbz5\"" Aug 05 17:14:22.192149 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.192130 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 05 17:14:22.194573 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.194552 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-d2b2t"] Aug 05 17:14:22.216697 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-serving-cert\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.216807 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-tmp\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.216807 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-snapshots\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.216807 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-service-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.216958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.216958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.216847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npm6n\" (UniqueName: \"kubernetes.io/projected/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-kube-api-access-npm6n\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.317914 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.317892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-serving-cert\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.317919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-tmp\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.317948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-snapshots\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.317985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-service-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.318018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.318041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npm6n\" (UniqueName: \"kubernetes.io/projected/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-kube-api-access-npm6n\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318594 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.318572 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-tmp\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318680 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.318639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-snapshots\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.318680 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.318647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-service-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.319081 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.319064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.320233 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.320216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-serving-cert\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.327078 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.327055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npm6n\" (UniqueName: \"kubernetes.io/projected/2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc-kube-api-access-npm6n\") pod \"insights-operator-77696685b-d2b2t\" (UID: \"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc\") " pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.393884 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.393859 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-754fbb68d6-44946"] Aug 05 17:14:22.395732 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.395715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.398717 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.398699 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 05 17:14:22.398794 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.398754 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 05 17:14:22.399023 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.399004 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 05 17:14:22.399106 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.399027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cz6hp\"" Aug 05 17:14:22.399106 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.399052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 05 17:14:22.399106 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.399061 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 05 17:14:22.399106 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.399078 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 05 17:14:22.413575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.413555 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-754fbb68d6-44946"] Aug 05 17:14:22.495681 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.495619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-d2b2t" Aug 05 17:14:22.519571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.519548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.519679 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.519598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.519679 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.519628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-stats-auth\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.519679 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.519657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj5fd\" (UniqueName: \"kubernetes.io/projected/2a67ec08-1897-4fbb-8317-170799f1c48b-kube-api-access-cj5fd\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.519828 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.519725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-default-certificate\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.616714 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.616686 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-d2b2t"] Aug 05 17:14:22.619142 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:14:22.619116 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a44eec4_a364_4121_9c9e_2ea7e6aaf4bc.slice/crio-d694f257dbc2cb1e4ece43a3de12fba4e2f14b5a6a4e2d1343dab6a27d9efbf7 WatchSource:0}: Error finding container d694f257dbc2cb1e4ece43a3de12fba4e2f14b5a6a4e2d1343dab6a27d9efbf7: Status 404 returned error can't find the container with id d694f257dbc2cb1e4ece43a3de12fba4e2f14b5a6a4e2d1343dab6a27d9efbf7 Aug 05 17:14:22.620049 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.620023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.620165 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.620080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.620165 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.620103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-stats-auth\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.620165 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.620132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj5fd\" (UniqueName: \"kubernetes.io/projected/2a67ec08-1897-4fbb-8317-170799f1c48b-kube-api-access-cj5fd\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.620309 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:22.620186 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:22.620309 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.620210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-default-certificate\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.620309 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:22.620244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:23.120224295 +0000 UTC m=+111.782960940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:22.620650 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:22.620611 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:23.120591413 +0000 UTC m=+111.783328076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:22.622724 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.622703 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-stats-auth\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.622840 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.622755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-default-certificate\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:22.628475 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:22.628457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj5fd\" (UniqueName: \"kubernetes.io/projected/2a67ec08-1897-4fbb-8317-170799f1c48b-kube-api-access-cj5fd\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:23.123102 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:23.123058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:23.123102 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:23.123111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:23.123315 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:23.123208 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:23.123315 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:23.123235 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:24.123221004 +0000 UTC m=+112.785957642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:23.123315 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:23.123261 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:24.123246004 +0000 UTC m=+112.785982646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:23.266652 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:23.266621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-d2b2t" event={"ID":"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc","Type":"ContainerStarted","Data":"d694f257dbc2cb1e4ece43a3de12fba4e2f14b5a6a4e2d1343dab6a27d9efbf7"} Aug 05 17:14:24.130280 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:24.130240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:24.130474 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:24.130297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:24.130474 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:24.130429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:26.130399874 +0000 UTC m=+114.793136516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:24.130474 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:24.130431 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:24.130640 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:24.130498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:26.130480424 +0000 UTC m=+114.793217066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:25.273242 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:25.273202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-d2b2t" event={"ID":"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc","Type":"ContainerStarted","Data":"b7ad160c9e9ec08cb4533324b0e78258190757336371dfc7e5babcd8885ab8f8"} Aug 05 17:14:25.295652 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:25.295596 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-d2b2t" podStartSLOduration=1.111865536 podStartE2EDuration="3.295575735s" totalImagesPullingTime="2.183710199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:25.294549409 +0000 UTC m=+113.957286069" watchObservedRunningTime="2026-08-05 17:14:25.295575735 +0000 UTC m=+113.958312398" Aug 05 17:14:26.147163 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:26.147129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:26.147315 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:26.147178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:26.147315 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:26.147289 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:26.147402 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:26.147325 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:30.147310585 +0000 UTC m=+118.810047237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:26.147402 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:26.147347 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:30.147333848 +0000 UTC m=+118.810070495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:27.426796 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.426765 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2lzdx"] Aug 05 17:14:27.429114 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.429098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.431564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.431536 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 17:14:27.431674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.431616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9fhk\"" Aug 05 17:14:27.431869 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.431848 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 17:14:27.451133 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.451111 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lzdx"] Aug 05 17:14:27.558533 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.558509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fbf86b9-6363-4faa-a833-4571b694bd2c-data-volume\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.558674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.558541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmwb\" (UniqueName: \"kubernetes.io/projected/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-api-access-zbmwb\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.558674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.558574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fbf86b9-6363-4faa-a833-4571b694bd2c-crio-socket\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.558674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.558617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.558674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.558667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.659729 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.659684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fbf86b9-6363-4faa-a833-4571b694bd2c-crio-socket\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.659729 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.659735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.659928 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.659779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.659928 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.659817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1fbf86b9-6363-4faa-a833-4571b694bd2c-crio-socket\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.659928 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:27.659875 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:27.659928 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:27.659912 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:27.660052 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:27.659925 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:28.159910294 +0000 UTC m=+116.822646949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : configmap "kube-rbac-proxy" not found Aug 05 17:14:27.660052 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.659994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fbf86b9-6363-4faa-a833-4571b694bd2c-data-volume\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.660052 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.660029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmwb\" (UniqueName: \"kubernetes.io/projected/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-api-access-zbmwb\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.660150 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:27.660068 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:28.160044421 +0000 UTC m=+116.822781060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:27.660266 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.660249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fbf86b9-6363-4faa-a833-4571b694bd2c-data-volume\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:27.673600 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:27.673570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmwb\" (UniqueName: \"kubernetes.io/projected/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-api-access-zbmwb\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:28.163943 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:28.163898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:28.163943 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:28.163957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:28.164168 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:28.164023 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:28.164168 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:28.164054 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:28.164168 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:28.164076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:29.164062061 +0000 UTC m=+117.826798703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : configmap "kube-rbac-proxy" not found Aug 05 17:14:28.164168 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:28.164117 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:29.164101189 +0000 UTC m=+117.826837827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:29.170152 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:29.170117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:29.170152 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:29.170159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:29.170591 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:29.170225 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:29.170591 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:29.170259 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:29.170591 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:29.170272 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:31.170259097 +0000 UTC m=+119.832995747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : configmap "kube-rbac-proxy" not found Aug 05 17:14:29.170591 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:29.170357 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:31.170345291 +0000 UTC m=+119.833081928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:29.526843 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:29.526818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t29x8_1a605a4f-fdab-496a-a599-e49eed4f3a1c/dns-node-resolver/0.log" Aug 05 17:14:29.929630 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:29.929558 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49sdz_52e85a9e-ea75-424e-89c3-9a7853635c86/node-ca/0.log" Aug 05 17:14:30.179250 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:30.179213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:30.179660 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:30.179269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:30.179660 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:30.179362 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:30.179660 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:30.179422 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:38.179389312 +0000 UTC m=+126.842125970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:30.179660 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:30.179441 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:38.179431909 +0000 UTC m=+126.842168550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:31.127165 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:31.127131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghsgr_da4a119f-cdbd-4d92-801b-dcaec9911afd/serve-healthcheck-canary/0.log" Aug 05 17:14:31.188119 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:31.188077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:31.188510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:31.188136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:31.188510 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:31.188231 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:31.188510 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:31.188279 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:31.188510 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:31.188298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:35.188281104 +0000 UTC m=+123.851017746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:31.188510 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:31.188340 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:35.188326342 +0000 UTC m=+123.851062980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : configmap "kube-rbac-proxy" not found Aug 05 17:14:32.329288 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.329251 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth"] Aug 05 17:14:32.331508 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.331486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:32.335765 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.335739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 05 17:14:32.335905 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.335790 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:32.335989 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.335973 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:32.336056 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.335980 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4dnlc\"" Aug 05 17:14:32.344362 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.344328 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth"] Aug 05 17:14:32.397046 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.397000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnc4\" (UniqueName: \"kubernetes.io/projected/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-kube-api-access-4vnc4\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:32.397215 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.397136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:32.497563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.497527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:32.497717 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:32.497687 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:32.497717 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.497699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnc4\" (UniqueName: \"kubernetes.io/projected/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-kube-api-access-4vnc4\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:32.497779 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:32.497768 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls podName:5652a1a0-8eeb-4ba8-8b01-d8e22f355469 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:32.997747514 +0000 UTC m=+121.660484164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-mcpth" (UID: "5652a1a0-8eeb-4ba8-8b01-d8e22f355469") : secret "samples-operator-tls" not found Aug 05 17:14:32.511117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:32.511079 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnc4\" (UniqueName: \"kubernetes.io/projected/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-kube-api-access-4vnc4\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:33.001338 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:33.001291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:33.001569 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:33.001487 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:33.001569 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:33.001567 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls podName:5652a1a0-8eeb-4ba8-8b01-d8e22f355469 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:34.001546395 +0000 UTC m=+122.664283034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-mcpth" (UID: "5652a1a0-8eeb-4ba8-8b01-d8e22f355469") : secret "samples-operator-tls" not found Aug 05 17:14:34.009516 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:34.009460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:34.009931 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:34.009614 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:34.009931 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:34.009684 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls podName:5652a1a0-8eeb-4ba8-8b01-d8e22f355469 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:36.009666818 +0000 UTC m=+124.672403456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-mcpth" (UID: "5652a1a0-8eeb-4ba8-8b01-d8e22f355469") : secret "samples-operator-tls" not found Aug 05 17:14:35.219738 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:35.219693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:35.219738 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:35.219745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:35.220184 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:35.219850 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:35.220184 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:35.219925 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.219908506 +0000 UTC m=+131.882645143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:35.220184 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:35.219954 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:35.220184 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:35.220015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.220002415 +0000 UTC m=+131.882739054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : configmap "kube-rbac-proxy" not found Aug 05 17:14:36.026180 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:36.026133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:36.026361 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:36.026288 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:36.026361 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:36.026354 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls podName:5652a1a0-8eeb-4ba8-8b01-d8e22f355469 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:40.026337165 +0000 UTC m=+128.689073813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-mcpth" (UID: "5652a1a0-8eeb-4ba8-8b01-d8e22f355469") : secret "samples-operator-tls" not found Aug 05 17:14:38.246763 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.246718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:38.247178 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.246794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:38.247178 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:38.246888 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:38.247178 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:38.246915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:54.246900474 +0000 UTC m=+142.909637115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:38.247178 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:38.246943 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs podName:2a67ec08-1897-4fbb-8317-170799f1c48b nodeName:}" failed. No retries permitted until 2026-08-05 17:14:54.246928623 +0000 UTC m=+142.909665261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs") pod "router-default-754fbb68d6-44946" (UID: "2a67ec08-1897-4fbb-8317-170799f1c48b") : secret "router-metrics-certs-default" not found Aug 05 17:14:38.975276 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.975244 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h8p5w"] Aug 05 17:14:38.977345 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.977321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:38.979313 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.979292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 05 17:14:38.979913 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.979897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 05 17:14:38.980176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.980158 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8rxbs\"" Aug 05 17:14:38.980284 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.980263 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 05 17:14:38.980345 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.980268 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 05 17:14:38.989211 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:38.989188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h8p5w"] Aug 05 17:14:39.052588 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.052548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb7gn\" (UniqueName: \"kubernetes.io/projected/fccd1fbe-132c-45d8-b314-3c50d325c3b7-kube-api-access-fb7gn\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.052588 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.052588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-key\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.052776 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.052708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-cabundle\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.153926 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.153892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-cabundle\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.154067 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.153959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb7gn\" (UniqueName: \"kubernetes.io/projected/fccd1fbe-132c-45d8-b314-3c50d325c3b7-kube-api-access-fb7gn\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.154067 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.153978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-key\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.154640 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.154621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-cabundle\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.156398 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.156381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fccd1fbe-132c-45d8-b314-3c50d325c3b7-signing-key\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.162941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.162920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb7gn\" (UniqueName: \"kubernetes.io/projected/fccd1fbe-132c-45d8-b314-3c50d325c3b7-kube-api-access-fb7gn\") pod \"service-ca-98c88fbb5-h8p5w\" (UID: \"fccd1fbe-132c-45d8-b314-3c50d325c3b7\") " pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.285682 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.285636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" Aug 05 17:14:39.413467 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:39.413428 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h8p5w"] Aug 05 17:14:39.418676 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:14:39.418641 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccd1fbe_132c_45d8_b314_3c50d325c3b7.slice/crio-b9b3fb8d3de5cffa8ec5543540c335ff05b3e41646a50ee32be03cfee9149f57 WatchSource:0}: Error finding container b9b3fb8d3de5cffa8ec5543540c335ff05b3e41646a50ee32be03cfee9149f57: Status 404 returned error can't find the container with id b9b3fb8d3de5cffa8ec5543540c335ff05b3e41646a50ee32be03cfee9149f57 Aug 05 17:14:40.061249 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:40.061209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:40.061443 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:40.061350 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:40.061492 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:40.061477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls podName:5652a1a0-8eeb-4ba8-8b01-d8e22f355469 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:48.06139876 +0000 UTC m=+136.724135402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-mcpth" (UID: "5652a1a0-8eeb-4ba8-8b01-d8e22f355469") : secret "samples-operator-tls" not found Aug 05 17:14:40.311710 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:40.311615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" event={"ID":"fccd1fbe-132c-45d8-b314-3c50d325c3b7","Type":"ContainerStarted","Data":"b9b3fb8d3de5cffa8ec5543540c335ff05b3e41646a50ee32be03cfee9149f57"} Aug 05 17:14:41.573525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:41.573489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:14:41.573907 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:41.573596 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:14:41.573907 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:41.573658 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs podName:a4d15ffe-a70c-4251-9109-15471c53c56f nodeName:}" failed. No retries permitted until 2026-08-05 17:16:43.573641138 +0000 UTC m=+252.236377782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs") pod "network-metrics-daemon-rpbtn" (UID: "a4d15ffe-a70c-4251-9109-15471c53c56f") : secret "metrics-daemon-secret" not found Aug 05 17:14:42.319525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:42.319482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" event={"ID":"fccd1fbe-132c-45d8-b314-3c50d325c3b7","Type":"ContainerStarted","Data":"90e2657518878ee1550e9596a8d62efd953ee6ce4dbc6b4502b641de91a2a785"} Aug 05 17:14:42.339974 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:42.339919 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-h8p5w" podStartSLOduration=2.2639718 podStartE2EDuration="4.33990252s" totalImagesPullingTime="2.07593072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:42.339336396 +0000 UTC m=+131.002073055" watchObservedRunningTime="2026-08-05 17:14:42.33990252 +0000 UTC m=+131.002639180" Aug 05 17:14:43.286447 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:43.286383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:43.286912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:43.286519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:43.286912 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:43.286551 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:43.286912 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:14:43.286629 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls podName:1fbf86b9-6363-4faa-a833-4571b694bd2c nodeName:}" failed. No retries permitted until 2026-08-05 17:14:59.286608402 +0000 UTC m=+147.949345259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2lzdx" (UID: "1fbf86b9-6363-4faa-a833-4571b694bd2c") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:43.287159 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:43.287140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1fbf86b9-6363-4faa-a833-4571b694bd2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:48.122353 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:48.122307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:48.124751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:48.124723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5652a1a0-8eeb-4ba8-8b01-d8e22f355469-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-mcpth\" (UID: \"5652a1a0-8eeb-4ba8-8b01-d8e22f355469\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:48.240041 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:48.240001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" Aug 05 17:14:48.373943 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:48.373844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth"] Aug 05 17:14:49.342863 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:49.342820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" event={"ID":"5652a1a0-8eeb-4ba8-8b01-d8e22f355469","Type":"ContainerStarted","Data":"ec15ceeb07aacc19e855117bd01d0dbf50b61204ee604cdecb90d5567df0f6fa"} Aug 05 17:14:51.351385 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:51.351342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" event={"ID":"5652a1a0-8eeb-4ba8-8b01-d8e22f355469","Type":"ContainerStarted","Data":"9dc825bc97bf435b36198d762264f7607b5b1141cd36390bfc5a30ff7db648dd"} Aug 05 17:14:51.351769 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:51.351446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" event={"ID":"5652a1a0-8eeb-4ba8-8b01-d8e22f355469","Type":"ContainerStarted","Data":"1def966a8404cef67c1029fd4b54617bffbd637445a7a6423f85c37d2996c2a9"} Aug 05 17:14:51.378901 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:51.378855 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-mcpth" podStartSLOduration=17.380078845 podStartE2EDuration="19.378839446s" totalImagesPullingTime="1.998760601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:51.378154974 +0000 UTC m=+140.040891635" watchObservedRunningTime="2026-08-05 17:14:51.378839446 +0000 UTC m=+140.041576105" Aug 05 17:14:54.271674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.271614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:54.271674 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.271679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:54.272273 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.272253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a67ec08-1897-4fbb-8317-170799f1c48b-service-ca-bundle\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:54.274039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.274013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a67ec08-1897-4fbb-8317-170799f1c48b-metrics-certs\") pod \"router-default-754fbb68d6-44946\" (UID: \"2a67ec08-1897-4fbb-8317-170799f1c48b\") " pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:54.511046 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.511010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cz6hp\"" Aug 05 17:14:54.515108 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.515087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:54.645297 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:54.645262 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-754fbb68d6-44946"] Aug 05 17:14:54.648226 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:14:54.648202 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a67ec08_1897_4fbb_8317_170799f1c48b.slice/crio-4bad03378bf2dfee92e49dcff7d947bd3e30e04369aef50788789c8daaea29a9 WatchSource:0}: Error finding container 4bad03378bf2dfee92e49dcff7d947bd3e30e04369aef50788789c8daaea29a9: Status 404 returned error can't find the container with id 4bad03378bf2dfee92e49dcff7d947bd3e30e04369aef50788789c8daaea29a9 Aug 05 17:14:55.363825 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:55.363783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-754fbb68d6-44946" event={"ID":"2a67ec08-1897-4fbb-8317-170799f1c48b","Type":"ContainerStarted","Data":"104eb1714694dd3c330ab75cd27887c13d36c7669083c452e7d634e2a2e2d855"} Aug 05 17:14:55.364202 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:55.363881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-754fbb68d6-44946" event={"ID":"2a67ec08-1897-4fbb-8317-170799f1c48b","Type":"ContainerStarted","Data":"4bad03378bf2dfee92e49dcff7d947bd3e30e04369aef50788789c8daaea29a9"} Aug 05 17:14:55.515325 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:55.515292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:55.517728 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:55.517706 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:55.548220 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:55.548168 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-754fbb68d6-44946" podStartSLOduration=33.548154015 podStartE2EDuration="33.548154015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:55.397909949 +0000 UTC m=+144.060646611" watchObservedRunningTime="2026-08-05 17:14:55.548154015 +0000 UTC m=+144.210890675" Aug 05 17:14:56.366968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:56.366936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:56.368239 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:56.368218 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-754fbb68d6-44946" Aug 05 17:14:59.309633 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:59.309591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:59.311818 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:59.311798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1fbf86b9-6363-4faa-a833-4571b694bd2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lzdx\" (UID: \"1fbf86b9-6363-4faa-a833-4571b694bd2c\") " pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:59.540718 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:59.540688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9fhk\"" Aug 05 17:14:59.548025 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:59.548007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lzdx" Aug 05 17:14:59.676372 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:14:59.676338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lzdx"] Aug 05 17:14:59.679579 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:14:59.679549 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbf86b9_6363_4faa_a833_4571b694bd2c.slice/crio-3c32d8ea2284eeea45d274cb7ca658e5c47e55bc0fc0226a0dcb3627b4d7d147 WatchSource:0}: Error finding container 3c32d8ea2284eeea45d274cb7ca658e5c47e55bc0fc0226a0dcb3627b4d7d147: Status 404 returned error can't find the container with id 3c32d8ea2284eeea45d274cb7ca658e5c47e55bc0fc0226a0dcb3627b4d7d147 Aug 05 17:15:00.379116 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:00.379092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lzdx" event={"ID":"1fbf86b9-6363-4faa-a833-4571b694bd2c","Type":"ContainerStarted","Data":"8bf7bb5e98ebcf37502846220f8479fe84bcfaac2db9426edd77de3999853653"} Aug 05 17:15:00.379390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:00.379141 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lzdx" event={"ID":"1fbf86b9-6363-4faa-a833-4571b694bd2c","Type":"ContainerStarted","Data":"3c32d8ea2284eeea45d274cb7ca658e5c47e55bc0fc0226a0dcb3627b4d7d147"} Aug 05 17:15:01.384239 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:01.384205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lzdx" event={"ID":"1fbf86b9-6363-4faa-a833-4571b694bd2c","Type":"ContainerStarted","Data":"31920f65ed921d0148f9a204b69a027c983f1bf1c969766549a5f0935fc3ef3a"} Aug 05 17:15:03.391722 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:03.391682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lzdx" event={"ID":"1fbf86b9-6363-4faa-a833-4571b694bd2c","Type":"ContainerStarted","Data":"035f9270a8c3e993f9312e6dc9017540f868c718a15341b5b89545f05b25857e"} Aug 05 17:15:03.430870 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:03.430825 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2lzdx" podStartSLOduration=33.618506292 podStartE2EDuration="36.430810702s" totalImagesPullingTime="2.81230441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:14:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:03.430105156 +0000 UTC m=+152.092841816" watchObservedRunningTime="2026-08-05 17:15:03.430810702 +0000 UTC m=+152.093547361" Aug 05 17:15:05.623304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.623218 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf"] Aug 05 17:15:05.629992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.629969 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr"] Aug 05 17:15:05.630157 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.630129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" Aug 05 17:15:05.632842 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.632816 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf6f69755-tps6r"] Aug 05 17:15:05.632967 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.632934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.635942 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.635923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.637771 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.637753 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g4lm6\"" Aug 05 17:15:05.639153 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.639135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf"] Aug 05 17:15:05.648216 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.648197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 17:15:05.648543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.648524 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 05 17:15:05.648695 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.648673 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 17:15:05.649218 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.649195 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 05 17:15:05.649218 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.649210 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xrzw4\"" Aug 05 17:15:05.649359 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.649278 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bzhzn\"" Aug 05 17:15:05.649634 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.649525 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 17:15:05.650130 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.650101 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr"] Aug 05 17:15:05.663020 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.662990 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 17:15:05.673496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.673450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf6f69755-tps6r"] Aug 05 17:15:05.725696 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.725667 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-bwk2x"] Aug 05 17:15:05.728640 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.728624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:05.732578 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.732556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 05 17:15:05.732787 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.732771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 05 17:15:05.733631 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.733613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-25rk5\"" Aug 05 17:15:05.756309 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756422 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756422 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llckp\" (UniqueName: \"kubernetes.io/projected/65a41e4c-baae-47b4-bc6b-de0249a40ef0-kube-api-access-llckp\") pod \"network-check-source-65bdbbff45-9wrgf\" (UID: \"65a41e4c-baae-47b4-bc6b-de0249a40ef0\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" Aug 05 17:15:05.756422 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxfw\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756422 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45d3e15c-4245-47d9-9f92-b72e347a3dbc-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45d3e15c-4245-47d9-9f92-b72e347a3dbc-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.756563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.756559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.765108 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.765089 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bwk2x"] Aug 05 17:15:05.853032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.852919 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf6f69755-tps6r"] Aug 05 17:15:05.853270 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:05.853191 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-dcxfw registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" podUID="4486f699-8a31-42cb-b9cd-a20876e1d3ba" Aug 05 17:15:05.873805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.873774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.873805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.873808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45d3e15c-4245-47d9-9f92-b72e347a3dbc-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.874035 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.873873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874035 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.873909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45d3e15c-4245-47d9-9f92-b72e347a3dbc-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.874035 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.873932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874180 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874180 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874180 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llckp\" (UniqueName: \"kubernetes.io/projected/65a41e4c-baae-47b4-bc6b-de0249a40ef0-kube-api-access-llckp\") pod \"network-check-source-65bdbbff45-9wrgf\" (UID: \"65a41e4c-baae-47b4-bc6b-de0249a40ef0\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" Aug 05 17:15:05.874318 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9br\" (UniqueName: \"kubernetes.io/projected/da66b9dc-07db-4263-8d4d-5c1c5e15d943-kube-api-access-jg9br\") pod \"downloads-77c974ffcf-bwk2x\" (UID: \"da66b9dc-07db-4263-8d4d-5c1c5e15d943\") " pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:05.874318 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxfw\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874318 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874318 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.874518 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.874402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.875072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.875039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45d3e15c-4245-47d9-9f92-b72e347a3dbc-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.875072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.875050 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.875643 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.875613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.876751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.876728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.876847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.876752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45d3e15c-4245-47d9-9f92-b72e347a3dbc-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-dtpmr\" (UID: \"45d3e15c-4245-47d9-9f92-b72e347a3dbc\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.877107 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.877082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.877426 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.877394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.924016 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.923989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.925621 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.925599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxfw\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw\") pod \"image-registry-5bf6f69755-tps6r\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:05.941823 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.941796 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llckp\" (UniqueName: \"kubernetes.io/projected/65a41e4c-baae-47b4-bc6b-de0249a40ef0-kube-api-access-llckp\") pod \"network-check-source-65bdbbff45-9wrgf\" (UID: \"65a41e4c-baae-47b4-bc6b-de0249a40ef0\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" Aug 05 17:15:05.946582 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.946556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" Aug 05 17:15:05.974890 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.974866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9br\" (UniqueName: \"kubernetes.io/projected/da66b9dc-07db-4263-8d4d-5c1c5e15d943-kube-api-access-jg9br\") pod \"downloads-77c974ffcf-bwk2x\" (UID: \"da66b9dc-07db-4263-8d4d-5c1c5e15d943\") " pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:05.992879 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:05.992856 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9br\" (UniqueName: \"kubernetes.io/projected/da66b9dc-07db-4263-8d4d-5c1c5e15d943-kube-api-access-jg9br\") pod \"downloads-77c974ffcf-bwk2x\" (UID: \"da66b9dc-07db-4263-8d4d-5c1c5e15d943\") " pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:06.037779 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.037753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:06.073609 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.073554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr"] Aug 05 17:15:06.076053 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:06.076028 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d3e15c_4245_47d9_9f92_b72e347a3dbc.slice/crio-bcf51292d547412954d8b83e5c14ceb2b3a4ecbaac6431159dd5425b0270e916 WatchSource:0}: Error finding container bcf51292d547412954d8b83e5c14ceb2b3a4ecbaac6431159dd5425b0270e916: Status 404 returned error can't find the container with id bcf51292d547412954d8b83e5c14ceb2b3a4ecbaac6431159dd5425b0270e916 Aug 05 17:15:06.173092 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.173065 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bwk2x"] Aug 05 17:15:06.176566 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:06.176544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda66b9dc_07db_4263_8d4d_5c1c5e15d943.slice/crio-b9c517756516a5f43b566512348f99cf76009a04dbbf00a33a155d4b4b9573ce WatchSource:0}: Error finding container b9c517756516a5f43b566512348f99cf76009a04dbbf00a33a155d4b4b9573ce: Status 404 returned error can't find the container with id b9c517756516a5f43b566512348f99cf76009a04dbbf00a33a155d4b4b9573ce Aug 05 17:15:06.239728 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.239703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" Aug 05 17:15:06.399042 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.399017 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf"] Aug 05 17:15:06.400968 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:06.400936 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a41e4c_baae_47b4_bc6b_de0249a40ef0.slice/crio-4b516320b338f919b11a6d52ebab3cb4c68bd067136662bde480a1705951903e WatchSource:0}: Error finding container 4b516320b338f919b11a6d52ebab3cb4c68bd067136662bde480a1705951903e: Status 404 returned error can't find the container with id 4b516320b338f919b11a6d52ebab3cb4c68bd067136662bde480a1705951903e Aug 05 17:15:06.401511 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.401485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bwk2x" event={"ID":"da66b9dc-07db-4263-8d4d-5c1c5e15d943","Type":"ContainerStarted","Data":"b9c517756516a5f43b566512348f99cf76009a04dbbf00a33a155d4b4b9573ce"} Aug 05 17:15:06.402569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.402551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:06.402569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.402557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" event={"ID":"45d3e15c-4245-47d9-9f92-b72e347a3dbc","Type":"ContainerStarted","Data":"bcf51292d547412954d8b83e5c14ceb2b3a4ecbaac6431159dd5425b0270e916"} Aug 05 17:15:06.408900 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.408885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:06.478162 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478135 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478347 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478178 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478347 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478219 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478347 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcxfw\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478347 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478278 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478347 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478339 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478617 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478366 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.478617 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478392 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates\") pod \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\" (UID: \"4486f699-8a31-42cb-b9cd-a20876e1d3ba\") " Aug 05 17:15:06.479017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.478953 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:06.479243 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.479122 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:06.479243 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.479120 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:15:06.480826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.480699 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:06.480826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.480794 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:06.480826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.480794 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw" (OuterVolumeSpecName: "kube-api-access-dcxfw") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "kube-api-access-dcxfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:06.481039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.481009 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:06.481434 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.481387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4486f699-8a31-42cb-b9cd-a20876e1d3ba" (UID: "4486f699-8a31-42cb-b9cd-a20876e1d3ba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:06.579575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579538 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579564 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-bound-sa-token\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579573 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcxfw\" (UniqueName: \"kubernetes.io/projected/4486f699-8a31-42cb-b9cd-a20876e1d3ba-kube-api-access-dcxfw\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579582 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-trusted-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579899 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579591 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4486f699-8a31-42cb-b9cd-a20876e1d3ba-ca-trust-extracted\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579899 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579604 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-installation-pull-secrets\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579899 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579616 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4486f699-8a31-42cb-b9cd-a20876e1d3ba-registry-certificates\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.579899 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.579625 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4486f699-8a31-42cb-b9cd-a20876e1d3ba-image-registry-private-configuration\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:06.765155 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.765131 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:06.769470 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.769453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.774483 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.774460 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 05 17:15:06.774483 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.774475 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 05 17:15:06.774739 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.774723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w7wwn\"" Aug 05 17:15:06.774988 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.774973 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 05 17:15:06.775061 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.775007 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 05 17:15:06.775432 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.775400 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 05 17:15:06.782352 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.782474 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.782525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.782525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.782597 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.782640 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.782611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zfh\" (UniqueName: \"kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.792593 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.792573 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:06.883419 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.883564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zfh\" (UniqueName: \"kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.883564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.883564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.883564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.883773 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.883589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.884258 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.884207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.884445 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.884377 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.884552 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.884522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.886340 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.886318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.886974 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.886953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:06.897433 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:06.897393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zfh\" (UniqueName: \"kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh\") pod \"console-6f6cc7cfb5-h59f9\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:07.085076 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.085002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:07.409081 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.409051 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf6f69755-tps6r" Aug 05 17:15:07.410459 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.410072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" event={"ID":"65a41e4c-baae-47b4-bc6b-de0249a40ef0","Type":"ContainerStarted","Data":"9d894dd83da263401f6910c8218a76c16cb8f9f4979d474a16ba25cd2870e953"} Aug 05 17:15:07.410459 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.410128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" event={"ID":"65a41e4c-baae-47b4-bc6b-de0249a40ef0","Type":"ContainerStarted","Data":"4b516320b338f919b11a6d52ebab3cb4c68bd067136662bde480a1705951903e"} Aug 05 17:15:07.434013 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.433686 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9wrgf" podStartSLOduration=2.43366482 podStartE2EDuration="2.43366482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:07.429349266 +0000 UTC m=+156.092085927" watchObservedRunningTime="2026-08-05 17:15:07.43366482 +0000 UTC m=+156.096401481" Aug 05 17:15:07.491898 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.491870 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf6f69755-tps6r"] Aug 05 17:15:07.496173 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.496121 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf6f69755-tps6r"] Aug 05 17:15:07.535849 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.535820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:07.538656 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:07.538627 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035f5d21_c87a_4a53_8778_7d9b6d75cf18.slice/crio-e784354b0eac08a325fd2db624a1e71656f1cbcfc97179c96ef36df8624bcadd WatchSource:0}: Error finding container e784354b0eac08a325fd2db624a1e71656f1cbcfc97179c96ef36df8624bcadd: Status 404 returned error can't find the container with id e784354b0eac08a325fd2db624a1e71656f1cbcfc97179c96ef36df8624bcadd Aug 05 17:15:07.907740 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:07.907710 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4486f699-8a31-42cb-b9cd-a20876e1d3ba" path="/var/lib/kubelet/pods/4486f699-8a31-42cb-b9cd-a20876e1d3ba/volumes" Aug 05 17:15:08.414749 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:08.414704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" event={"ID":"45d3e15c-4245-47d9-9f92-b72e347a3dbc","Type":"ContainerStarted","Data":"18a0364bdf87b1f2a03853c18b0e3d3eb0ae4604797b47d72e247426b95086c3"} Aug 05 17:15:08.416356 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:08.416327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cc7cfb5-h59f9" event={"ID":"035f5d21-c87a-4a53-8778-7d9b6d75cf18","Type":"ContainerStarted","Data":"e784354b0eac08a325fd2db624a1e71656f1cbcfc97179c96ef36df8624bcadd"} Aug 05 17:15:08.437129 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:08.437074 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-dtpmr" podStartSLOduration=2.098573247 podStartE2EDuration="3.437054596s" totalImagesPullingTime="1.338481349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:08.435920077 +0000 UTC m=+157.098656737" watchObservedRunningTime="2026-08-05 17:15:08.437054596 +0000 UTC m=+157.099791257" Aug 05 17:15:08.722217 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:08.722128 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pbvdz" podUID="fd1077d4-d334-4841-8320-79b660e24365" Aug 05 17:15:08.998042 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:08.997863 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4wz45"] Aug 05 17:15:09.001939 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.001768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.007886 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.007857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pjwb8\"" Aug 05 17:15:09.008150 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.008064 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 05 17:15:09.008977 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.008737 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 17:15:09.008977 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.008803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 17:15:09.009138 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.009063 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 17:15:09.013144 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.013120 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 05 17:15:09.021758 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.021700 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4wz45"] Aug 05 17:15:09.103259 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.103181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.103259 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.103231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.103520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.103292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.103520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.103320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5585l\" (UniqueName: \"kubernetes.io/projected/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-kube-api-access-5585l\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.139525 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.138983 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:09.142733 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.142698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.155682 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.154279 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 05 17:15:09.160135 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.160105 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:09.203871 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.203841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5585l\" (UniqueName: \"kubernetes.io/projected/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-kube-api-access-5585l\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.203989 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.203902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.203989 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.203954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.203989 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.203982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204148 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76hpz\" (UniqueName: \"kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204148 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204148 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.204304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.204304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.204304 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:09.204281 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Aug 05 17:15:09.204503 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:09.204336 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls podName:3d8baa3f-f918-4a48-b177-61bb20c4e8c2 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:09.704318431 +0000 UTC m=+158.367055073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-4wz45" (UID: "3d8baa3f-f918-4a48-b177-61bb20c4e8c2") : secret "prometheus-operator-tls" not found Aug 05 17:15:09.204803 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.204777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.207032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.207009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.215878 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.215830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5585l\" (UniqueName: \"kubernetes.io/projected/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-kube-api-access-5585l\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.305092 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305225 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76hpz\" (UniqueName: \"kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305225 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305225 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305225 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.305912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.305888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.306103 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.306058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.306199 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.306163 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.306744 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.306718 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.309200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.309177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.309429 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.309388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.315544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.315520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76hpz\" (UniqueName: \"kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz\") pod \"console-6b86dd784c-4qpwg\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.421447 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.421193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:09.460191 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.460095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:09.628401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.628319 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:09.631920 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:09.631884 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbe1340_a228_4ae8_bd56_e6044b423945.slice/crio-d9411ea4062752263d6700ab2b9f71532d4b01664fd072eacdecc4f61e8be8d8 WatchSource:0}: Error finding container d9411ea4062752263d6700ab2b9f71532d4b01664fd072eacdecc4f61e8be8d8: Status 404 returned error can't find the container with id d9411ea4062752263d6700ab2b9f71532d4b01664fd072eacdecc4f61e8be8d8 Aug 05 17:15:09.709483 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:09.709362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:09.709661 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:09.709641 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Aug 05 17:15:09.709720 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:09.709705 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls podName:3d8baa3f-f918-4a48-b177-61bb20c4e8c2 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:10.709690358 +0000 UTC m=+159.372426996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-4wz45" (UID: "3d8baa3f-f918-4a48-b177-61bb20c4e8c2") : secret "prometheus-operator-tls" not found Aug 05 17:15:09.913592 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:09.913503 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rpbtn" podUID="a4d15ffe-a70c-4251-9109-15471c53c56f" Aug 05 17:15:10.426605 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:10.426536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86dd784c-4qpwg" event={"ID":"1dbe1340-a228-4ae8-bd56-e6044b423945","Type":"ContainerStarted","Data":"d9411ea4062752263d6700ab2b9f71532d4b01664fd072eacdecc4f61e8be8d8"} Aug 05 17:15:10.719589 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:10.719511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:10.722401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:10.722370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d8baa3f-f918-4a48-b177-61bb20c4e8c2-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4wz45\" (UID: \"3d8baa3f-f918-4a48-b177-61bb20c4e8c2\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:10.814394 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:10.814357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" Aug 05 17:15:11.148299 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:11.148270 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4wz45"] Aug 05 17:15:11.153081 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:11.153051 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8baa3f_f918_4a48_b177_61bb20c4e8c2.slice/crio-98eafde67b133446c37e793982734f1911fda25d38eb08900ce1d155b61261c4 WatchSource:0}: Error finding container 98eafde67b133446c37e793982734f1911fda25d38eb08900ce1d155b61261c4: Status 404 returned error can't find the container with id 98eafde67b133446c37e793982734f1911fda25d38eb08900ce1d155b61261c4 Aug 05 17:15:11.431616 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:11.431577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" event={"ID":"3d8baa3f-f918-4a48-b177-61bb20c4e8c2","Type":"ContainerStarted","Data":"98eafde67b133446c37e793982734f1911fda25d38eb08900ce1d155b61261c4"} Aug 05 17:15:11.433290 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:11.433249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86dd784c-4qpwg" event={"ID":"1dbe1340-a228-4ae8-bd56-e6044b423945","Type":"ContainerStarted","Data":"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996"} Aug 05 17:15:11.434856 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:11.434820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cc7cfb5-h59f9" event={"ID":"035f5d21-c87a-4a53-8778-7d9b6d75cf18","Type":"ContainerStarted","Data":"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13"} Aug 05 17:15:11.467469 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:11.467396 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b86dd784c-4qpwg" podStartSLOduration=1.037578316 podStartE2EDuration="2.467375292s" totalImagesPullingTime="1.429796976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:11.466376527 +0000 UTC m=+160.129113187" watchObservedRunningTime="2026-08-05 17:15:11.467375292 +0000 UTC m=+160.130111954" Aug 05 17:15:13.444139 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.444100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" event={"ID":"3d8baa3f-f918-4a48-b177-61bb20c4e8c2","Type":"ContainerStarted","Data":"f4d92dd26a2346ecf9b9e3997d81199854c3269ba137bfa63accd5c9b1688147"} Aug 05 17:15:13.444631 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.444169 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" event={"ID":"3d8baa3f-f918-4a48-b177-61bb20c4e8c2","Type":"ContainerStarted","Data":"3007bc83f9cce292a8dffdadae96a768447f2d133e213a4da6840a12d39d8e00"} Aug 05 17:15:13.468323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.468277 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f6cc7cfb5-h59f9" podStartSLOduration=3.945821476 podStartE2EDuration="7.468263197s" totalImagesPullingTime="3.522441721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:11.493678077 +0000 UTC m=+160.156414737" watchObservedRunningTime="2026-08-05 17:15:13.468263197 +0000 UTC m=+162.130999857" Aug 05 17:15:13.468627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.468594 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-4wz45" podStartSLOduration=4.211823397 podStartE2EDuration="5.468587881s" totalImagesPullingTime="1.256764484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:13.46818434 +0000 UTC m=+162.130921003" watchObservedRunningTime="2026-08-05 17:15:13.468587881 +0000 UTC m=+162.131324518" Aug 05 17:15:13.545958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.545924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:13.548425 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.548384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1077d4-d334-4841-8320-79b660e24365-metrics-tls\") pod \"dns-default-pbvdz\" (UID: \"fd1077d4-d334-4841-8320-79b660e24365\") " pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:13.624842 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.624815 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hnrl\"" Aug 05 17:15:13.633163 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.633137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:13.776556 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:13.776525 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pbvdz"] Aug 05 17:15:13.779765 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:13.779733 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1077d4_d334_4841_8320_79b660e24365.slice/crio-1f765de2d4305120f2147efa82e8ce5c0b5c1d080c9b34d3146080d80faddd45 WatchSource:0}: Error finding container 1f765de2d4305120f2147efa82e8ce5c0b5c1d080c9b34d3146080d80faddd45: Status 404 returned error can't find the container with id 1f765de2d4305120f2147efa82e8ce5c0b5c1d080c9b34d3146080d80faddd45 Aug 05 17:15:14.450035 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:14.449985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbvdz" event={"ID":"fd1077d4-d334-4841-8320-79b660e24365","Type":"ContainerStarted","Data":"1f765de2d4305120f2147efa82e8ce5c0b5c1d080c9b34d3146080d80faddd45"} Aug 05 17:15:15.388594 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.388561 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-slvjn"] Aug 05 17:15:15.391826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.391768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.399117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.396616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 17:15:15.399117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.396893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-64j8g\"" Aug 05 17:15:15.399117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.398238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 17:15:15.399117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.398878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-root\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-textfile\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-accelerators-collector-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-sys\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.464686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-wtmp\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.465342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-metrics-client-ca\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.465342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.464744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8cf\" (UniqueName: \"kubernetes.io/projected/2c6ff2ea-1229-4cc9-8358-53040590d877-kube-api-access-jh8cf\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.565388 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-root\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.565388 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.565388 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565329 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-root\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.565388 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.565682 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:15.565476 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 05 17:15:15.565682 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:15.565540 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls podName:2c6ff2ea-1229-4cc9-8358-53040590d877 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:16.065520275 +0000 UTC m=+164.728256918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls") pod "node-exporter-slvjn" (UID: "2c6ff2ea-1229-4cc9-8358-53040590d877") : secret "node-exporter-tls" not found Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-textfile\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-accelerators-collector-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-sys\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-wtmp\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.565992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-metrics-client-ca\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8cf\" (UniqueName: \"kubernetes.io/projected/2c6ff2ea-1229-4cc9-8358-53040590d877-kube-api-access-jh8cf\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-textfile\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566321 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-sys\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566771 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566389 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-wtmp\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566771 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-metrics-client-ca\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.566862 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.566804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-accelerators-collector-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.568031 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.568007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:15.577392 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:15.577371 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8cf\" (UniqueName: \"kubernetes.io/projected/2c6ff2ea-1229-4cc9-8358-53040590d877-kube-api-access-jh8cf\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:16.070604 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.070571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:16.073017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.072992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c6ff2ea-1229-4cc9-8358-53040590d877-node-exporter-tls\") pod \"node-exporter-slvjn\" (UID: \"2c6ff2ea-1229-4cc9-8358-53040590d877\") " pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:16.308074 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.308039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slvjn" Aug 05 17:15:16.324271 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:16.324238 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6ff2ea_1229_4cc9_8358_53040590d877.slice/crio-b3467ef14c9f082b0d1de3880a1f8e6779dd17edf627904a74c871deef1303c4 WatchSource:0}: Error finding container b3467ef14c9f082b0d1de3880a1f8e6779dd17edf627904a74c871deef1303c4: Status 404 returned error can't find the container with id b3467ef14c9f082b0d1de3880a1f8e6779dd17edf627904a74c871deef1303c4 Aug 05 17:15:16.436547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.436505 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:15:16.440457 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.440433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.444302 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.443930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 05 17:15:16.444302 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mg9f5\"" Aug 05 17:15:16.444302 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 05 17:15:16.444557 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 05 17:15:16.444557 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444388 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 05 17:15:16.445039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444795 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 05 17:15:16.445039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 05 17:15:16.445039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 05 17:15:16.445039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444802 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 05 17:15:16.445039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.444981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 05 17:15:16.460398 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.460374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:15:16.461351 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.461321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slvjn" event={"ID":"2c6ff2ea-1229-4cc9-8358-53040590d877","Type":"ContainerStarted","Data":"b3467ef14c9f082b0d1de3880a1f8e6779dd17edf627904a74c871deef1303c4"} Aug 05 17:15:16.463941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.463864 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbvdz" event={"ID":"fd1077d4-d334-4841-8320-79b660e24365","Type":"ContainerStarted","Data":"001da2a977dc1e2bf22b4372272f95f5222066bc7b7a6672817a19d0df773792"} Aug 05 17:15:16.463941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.463908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pbvdz" event={"ID":"fd1077d4-d334-4841-8320-79b660e24365","Type":"ContainerStarted","Data":"676e735c325743693093d5f87e8e650db8aec907ae52af0746dcfd8ba3ed494f"} Aug 05 17:15:16.464169 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.464146 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:16.474215 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2snr\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474602 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474982 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474982 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.474982 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.474723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.515271 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.515219 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pbvdz" podStartSLOduration=129.814613159 podStartE2EDuration="2m11.515200644s" totalImagesPullingTime="1.700587485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:16.513734928 +0000 UTC m=+165.176471589" watchObservedRunningTime="2026-08-05 17:15:16.515200644 +0000 UTC m=+165.177937311" Aug 05 17:15:16.576151 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576151 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576151 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2snr\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.576715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.576701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.577236 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.577203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580062 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.579511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580062 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.579564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580062 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.579797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580062 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.579834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580062 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:16.579908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle podName:97c1444e-43f4-499f-a027-56931d931b63 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:17.079890476 +0000 UTC m=+165.742627121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "97c1444e-43f4-499f-a027-56931d931b63") : configmap references non-existent config key: ca-bundle.crt Aug 05 17:15:16.580371 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.580278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580489 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.580445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580638 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.580618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580681 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.580657 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.580725 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.580686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.582073 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.582057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:16.585738 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:16.585720 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2snr\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:17.080826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.080780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:17.081562 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.081540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:17.085736 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.085703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:17.085844 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.085776 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:17.087434 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.087390 2579 patch_prober.go:28] interesting pod/console-6f6cc7cfb5-h59f9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Aug 05 17:15:17.087529 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.087454 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f6cc7cfb5-h59f9" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Aug 05 17:15:17.353465 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:17.353378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:15:19.460847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:19.460807 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:19.461304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:19.460881 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:19.462499 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:19.462470 2579 patch_prober.go:28] interesting pod/console-6b86dd784c-4qpwg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Aug 05 17:15:19.462639 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:19.462523 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b86dd784c-4qpwg" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Aug 05 17:15:20.165189 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.165155 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk"] Aug 05 17:15:20.167861 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.167838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.170452 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.170394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mmzm4\"" Aug 05 17:15:20.171718 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.171694 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:20.171836 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.171761 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 05 17:15:20.178905 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.178854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk"] Aug 05 17:15:20.206254 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.206227 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:15:20.208487 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.208468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.210964 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.210937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.211078 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.211034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfpdg\" (UniqueName: \"kubernetes.io/projected/93e85987-b9b1-4f30-8dbb-9fce5e730385-kube-api-access-cfpdg\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.223715 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.223685 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:15:20.311591 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k657j\" (UniqueName: \"kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.311770 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.311770 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.311770 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.311922 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:20.311834 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 05 17:15:20.311922 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.311922 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:20.311898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert podName:93e85987-b9b1-4f30-8dbb-9fce5e730385 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:20.811878889 +0000 UTC m=+169.474615542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-8zrfk" (UID: "93e85987-b9b1-4f30-8dbb-9fce5e730385") : secret "monitoring-plugin-cert" not found Aug 05 17:15:20.312076 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.312076 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.311967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.312076 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.312000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfpdg\" (UniqueName: \"kubernetes.io/projected/93e85987-b9b1-4f30-8dbb-9fce5e730385-kube-api-access-cfpdg\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.312076 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.312016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.321868 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.321842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfpdg\" (UniqueName: \"kubernetes.io/projected/93e85987-b9b1-4f30-8dbb-9fce5e730385-kube-api-access-cfpdg\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.412711 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.412670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.412872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.412722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.412872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.412857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k657j\" (UniqueName: \"kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.412992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.412933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.412992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.412957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.413088 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.413023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.413088 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.413063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.413548 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.413497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.413961 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.413937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.414126 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.414096 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.414219 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.414198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.415943 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.415865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.416044 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.415972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.424921 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.424898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k657j\" (UniqueName: \"kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j\") pod \"console-694d667859-rtflf\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.519223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.519187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:20.817285 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:20.817247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:20.817466 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:20.817404 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 05 17:15:20.817540 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:20.817480 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert podName:93e85987-b9b1-4f30-8dbb-9fce5e730385 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:21.817464078 +0000 UTC m=+170.480200717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-8zrfk" (UID: "93e85987-b9b1-4f30-8dbb-9fce5e730385") : secret "monitoring-plugin-cert" not found Aug 05 17:15:21.791441 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.791149 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:21.794612 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.794585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.802039 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.801681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 17:15:21.802658 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.802636 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 17:15:21.802990 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.802971 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 17:15:21.803301 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.803040 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 17:15:21.803301 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.803164 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 17:15:21.803301 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.803118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 17:15:21.803953 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.803933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 17:15:21.804040 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.803976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 17:15:21.804090 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.804067 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9kh9mr2s9i29u\"" Aug 05 17:15:21.804136 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.804102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 17:15:21.804587 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.804509 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 17:15:21.804905 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.804861 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 17:15:21.805236 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.805049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 17:15:21.805236 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.805140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 17:15:21.805236 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.805197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-npxht\"" Aug 05 17:15:21.807440 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.807296 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 17:15:21.822568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.822537 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 17:15:21.825441 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.825395 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:21.829140 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.829102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:21.829320 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:21.829302 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 05 17:15:21.829400 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:21.829376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert podName:93e85987-b9b1-4f30-8dbb-9fce5e730385 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:23.829356442 +0000 UTC m=+172.492093097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-8zrfk" (UID: "93e85987-b9b1-4f30-8dbb-9fce5e730385") : secret "monitoring-plugin-cert" not found Aug 05 17:15:21.930397 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930804 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930804 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930804 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930804 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930804 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.930968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.930977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.931003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.931035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.931052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.931075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:21.931196 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:21.931097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cr65\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.033898 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.033852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.033905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.033940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.033996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cr65\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034323 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.034641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.034621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.035359 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.035331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.037708 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.037327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.037801 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.037759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.038563 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.038302 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.038842 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.038817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.039068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.039043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.039357 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.039331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.039480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.039569 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.039617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.040231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.041796 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.041929 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.042496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.042248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.043666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.043642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.044256 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.043872 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.044256 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.044216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.044918 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.044893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.050084 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.050063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cr65\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65\") pod \"prometheus-k8s-0\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:22.110845 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:22.110807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:23.853586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:23.853503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:23.856217 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:23.856191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93e85987-b9b1-4f30-8dbb-9fce5e730385-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8zrfk\" (UID: \"93e85987-b9b1-4f30-8dbb-9fce5e730385\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:24.066649 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.066539 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:24.068703 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:24.068657 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5303631a_7792_48e7_bf16_d25aa3760348.slice/crio-9a369f83b0b0d278afe2694aaaa368d8615162466970a7dd4b7de37e87e5a45a WatchSource:0}: Error finding container 9a369f83b0b0d278afe2694aaaa368d8615162466970a7dd4b7de37e87e5a45a: Status 404 returned error can't find the container with id 9a369f83b0b0d278afe2694aaaa368d8615162466970a7dd4b7de37e87e5a45a Aug 05 17:15:24.080482 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.080457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:24.256881 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.256796 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk"] Aug 05 17:15:24.270153 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:24.270120 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e85987_b9b1_4f30_8dbb_9fce5e730385.slice/crio-50c99c6f66703d08e3cd7a1eba1223266f8f7c5387e7c6a59ce7dd61228116a7 WatchSource:0}: Error finding container 50c99c6f66703d08e3cd7a1eba1223266f8f7c5387e7c6a59ce7dd61228116a7: Status 404 returned error can't find the container with id 50c99c6f66703d08e3cd7a1eba1223266f8f7c5387e7c6a59ce7dd61228116a7 Aug 05 17:15:24.290897 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.290867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:15:24.294423 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:24.294384 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0887375_8419_40a8_be9f_05798a57fe74.slice/crio-f10a22dbf9da34d8f83ebd5fcf13eac88337eb6f958487765beecec20e9dcc46 WatchSource:0}: Error finding container f10a22dbf9da34d8f83ebd5fcf13eac88337eb6f958487765beecec20e9dcc46: Status 404 returned error can't find the container with id f10a22dbf9da34d8f83ebd5fcf13eac88337eb6f958487765beecec20e9dcc46 Aug 05 17:15:24.302501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.302383 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:15:24.307310 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:15:24.307279 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c1444e_43f4_499f_a027_56931d931b63.slice/crio-215321449f567a6a4e95cdfd6a9c4b72b2a73173e7e985017ba1e621d154cccf WatchSource:0}: Error finding container 215321449f567a6a4e95cdfd6a9c4b72b2a73173e7e985017ba1e621d154cccf: Status 404 returned error can't find the container with id 215321449f567a6a4e95cdfd6a9c4b72b2a73173e7e985017ba1e621d154cccf Aug 05 17:15:24.500651 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.500554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bwk2x" event={"ID":"da66b9dc-07db-4263-8d4d-5c1c5e15d943","Type":"ContainerStarted","Data":"f35af5bfa799c74e86a34dc640879e858c837299c9598e430632eae65a6cbc2e"} Aug 05 17:15:24.501455 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.501379 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:24.503585 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.503553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"215321449f567a6a4e95cdfd6a9c4b72b2a73173e7e985017ba1e621d154cccf"} Aug 05 17:15:24.504966 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.504940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" event={"ID":"93e85987-b9b1-4f30-8dbb-9fce5e730385","Type":"ContainerStarted","Data":"50c99c6f66703d08e3cd7a1eba1223266f8f7c5387e7c6a59ce7dd61228116a7"} Aug 05 17:15:24.506403 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.506373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"9a369f83b0b0d278afe2694aaaa368d8615162466970a7dd4b7de37e87e5a45a"} Aug 05 17:15:24.508456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.508383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694d667859-rtflf" event={"ID":"d0887375-8419-40a8-be9f-05798a57fe74","Type":"ContainerStarted","Data":"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe"} Aug 05 17:15:24.508456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.508448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694d667859-rtflf" event={"ID":"d0887375-8419-40a8-be9f-05798a57fe74","Type":"ContainerStarted","Data":"f10a22dbf9da34d8f83ebd5fcf13eac88337eb6f958487765beecec20e9dcc46"} Aug 05 17:15:24.515454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.515425 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-bwk2x" Aug 05 17:15:24.556689 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.556632 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-bwk2x" podStartSLOduration=1.764944935 podStartE2EDuration="19.556609414s" totalImagesPullingTime="17.791664479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:24.529776399 +0000 UTC m=+173.192513082" watchObservedRunningTime="2026-08-05 17:15:24.556609414 +0000 UTC m=+173.219346076" Aug 05 17:15:24.596530 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.596466 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-694d667859-rtflf" podStartSLOduration=4.596440744 podStartE2EDuration="4.596440744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:24.595623452 +0000 UTC m=+173.258360115" watchObservedRunningTime="2026-08-05 17:15:24.596440744 +0000 UTC m=+173.259177405" Aug 05 17:15:24.902013 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:24.901673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:15:25.517029 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:25.515528 2579 generic.go:356] "Generic (PLEG): container finished" podID="2c6ff2ea-1229-4cc9-8358-53040590d877" containerID="3265c4dcd650f47c3a96f7ad15043f14a64b91fa113c06aa1df5e0d8e98ac658" exitCode=0 Aug 05 17:15:25.517029 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:25.515837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slvjn" event={"ID":"2c6ff2ea-1229-4cc9-8358-53040590d877","Type":"ContainerDied","Data":"3265c4dcd650f47c3a96f7ad15043f14a64b91fa113c06aa1df5e0d8e98ac658"} Aug 05 17:15:26.469892 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:26.469859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pbvdz" Aug 05 17:15:27.526747 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.526705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" event={"ID":"93e85987-b9b1-4f30-8dbb-9fce5e730385","Type":"ContainerStarted","Data":"8a989771640699dc7da9d7fe70d5266c69b59f7dfce7835c2d673e1fbc78ba9c"} Aug 05 17:15:27.527246 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.526806 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:27.528929 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.528894 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" exitCode=0 Aug 05 17:15:27.529051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.528987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} Aug 05 17:15:27.531826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.531798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slvjn" event={"ID":"2c6ff2ea-1229-4cc9-8358-53040590d877","Type":"ContainerStarted","Data":"f015ce720bc0fd4acc90283df63e79af7b161701b7c4c9741c4e82513f86e684"} Aug 05 17:15:27.531923 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.531849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slvjn" event={"ID":"2c6ff2ea-1229-4cc9-8358-53040590d877","Type":"ContainerStarted","Data":"8ad25d48acec232995f1d1c19dfb3736d8a1d27af1346d1467715bbf067e4aef"} Aug 05 17:15:27.533599 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.533548 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" Aug 05 17:15:27.533599 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.533573 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a" exitCode=0 Aug 05 17:15:27.533599 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.533589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a"} Aug 05 17:15:27.552903 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.552844 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8zrfk" podStartSLOduration=5.2853481460000005 podStartE2EDuration="7.552824403s" totalImagesPullingTime="2.267476257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:27.551479256 +0000 UTC m=+176.214215915" watchObservedRunningTime="2026-08-05 17:15:27.552824403 +0000 UTC m=+176.215561062" Aug 05 17:15:27.715423 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:27.715351 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-slvjn" podStartSLOduration=4.269648457 podStartE2EDuration="12.715334186s" totalImagesPullingTime="8.339636728s" totalInitContainerRuntime="106.049001ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:27.714704746 +0000 UTC m=+176.377441407" watchObservedRunningTime="2026-08-05 17:15:27.715334186 +0000 UTC m=+176.378070824" Aug 05 17:15:29.467294 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:29.467259 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:29.473019 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:29.472989 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:30.520710 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.519952 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:30.520710 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.520028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:30.528519 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.528272 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:30.557819 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.557118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c"} Aug 05 17:15:30.557819 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.557197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45"} Aug 05 17:15:30.557819 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.557241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de"} Aug 05 17:15:30.557819 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.557280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564"} Aug 05 17:15:30.557819 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.557317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a"} Aug 05 17:15:30.562503 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.562483 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:15:30.639469 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:30.639356 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:32.570854 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:32.570759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} Aug 05 17:15:33.579528 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:33.579437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerStarted","Data":"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2"} Aug 05 17:15:33.582009 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:33.581983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} Aug 05 17:15:33.614124 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:33.614049 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.459447555 podStartE2EDuration="17.614033678s" totalImagesPullingTime="7.145497759s" totalInitContainerRuntime="9.088364ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:33.612047504 +0000 UTC m=+182.274784165" watchObservedRunningTime="2026-08-05 17:15:33.614033678 +0000 UTC m=+182.276770338" Aug 05 17:15:35.598944 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:35.598910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} Aug 05 17:15:36.607886 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:36.607843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} Aug 05 17:15:36.608493 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:36.607925 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} Aug 05 17:15:36.608493 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:36.607967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerStarted","Data":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} Aug 05 17:15:36.642864 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:36.642787 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.896119741 podStartE2EDuration="15.642764478s" totalImagesPullingTime="9.717895597s" totalInitContainerRuntime="28.74914ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:36.640671584 +0000 UTC m=+185.303408246" watchObservedRunningTime="2026-08-05 17:15:36.642764478 +0000 UTC m=+185.305501142" Aug 05 17:15:37.111505 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:37.111466 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:45.196402 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.196335 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f6cc7cfb5-h59f9" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerName="console" containerID="cri-o://b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13" gracePeriod=15 Aug 05 17:15:45.471300 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.471244 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:45.589805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.589777 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.589945 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.589835 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.589945 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.589867 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.590072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590029 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8zfh\" (UniqueName: \"kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.590072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590066 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.590185 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590110 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca\") pod \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\" (UID: \"035f5d21-c87a-4a53-8778-7d9b6d75cf18\") " Aug 05 17:15:45.590238 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590221 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config" (OuterVolumeSpecName: "console-config") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:45.590373 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590354 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.590564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590486 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:45.590652 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.590600 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca" (OuterVolumeSpecName: "service-ca") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:45.592044 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.592014 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:45.592246 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.592222 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:45.592311 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.592226 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh" (OuterVolumeSpecName: "kube-api-access-h8zfh") pod "035f5d21-c87a-4a53-8778-7d9b6d75cf18" (UID: "035f5d21-c87a-4a53-8778-7d9b6d75cf18"). InnerVolumeSpecName "kube-api-access-h8zfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:45.646751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.646720 2579 generic.go:356] "Generic (PLEG): container finished" podID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerID="b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13" exitCode=0 Aug 05 17:15:45.646856 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.646763 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6cc7cfb5-h59f9" Aug 05 17:15:45.646856 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.646768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cc7cfb5-h59f9" event={"ID":"035f5d21-c87a-4a53-8778-7d9b6d75cf18","Type":"ContainerDied","Data":"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13"} Aug 05 17:15:45.646856 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.646816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6cc7cfb5-h59f9" event={"ID":"035f5d21-c87a-4a53-8778-7d9b6d75cf18","Type":"ContainerDied","Data":"e784354b0eac08a325fd2db624a1e71656f1cbcfc97179c96ef36df8624bcadd"} Aug 05 17:15:45.646856 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.646840 2579 scope.go:117] "RemoveContainer" containerID="b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13" Aug 05 17:15:45.661063 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.661047 2579 scope.go:117] "RemoveContainer" containerID="b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13" Aug 05 17:15:45.661328 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:45.661303 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13\": container with ID starting with b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13 not found: ID does not exist" containerID="b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13" Aug 05 17:15:45.661439 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.661338 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13"} err="failed to get container status \"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13\": rpc error: code = NotFound desc = could not find container \"b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13\": container with ID starting with b20829a744ff0fda7a384db6c75c5533ce4bf7efcc22157f461555a8540e8c13 not found: ID does not exist" Aug 05 17:15:45.668966 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.668943 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:45.676439 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.676401 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f6cc7cfb5-h59f9"] Aug 05 17:15:45.691496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.691479 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-oauth-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.691568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.691498 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/035f5d21-c87a-4a53-8778-7d9b6d75cf18-console-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.691568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.691510 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8zfh\" (UniqueName: \"kubernetes.io/projected/035f5d21-c87a-4a53-8778-7d9b6d75cf18-kube-api-access-h8zfh\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.691568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.691520 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-oauth-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.691568 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.691529 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/035f5d21-c87a-4a53-8778-7d9b6d75cf18-service-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:45.907377 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:45.907349 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" path="/var/lib/kubelet/pods/035f5d21-c87a-4a53-8778-7d9b6d75cf18/volumes" Aug 05 17:15:51.671454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:51.671358 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc" containerID="b7ad160c9e9ec08cb4533324b0e78258190757336371dfc7e5babcd8885ab8f8" exitCode=0 Aug 05 17:15:51.671796 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:51.671440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-d2b2t" event={"ID":"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc","Type":"ContainerDied","Data":"b7ad160c9e9ec08cb4533324b0e78258190757336371dfc7e5babcd8885ab8f8"} Aug 05 17:15:51.671796 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:51.671767 2579 scope.go:117] "RemoveContainer" containerID="b7ad160c9e9ec08cb4533324b0e78258190757336371dfc7e5babcd8885ab8f8" Aug 05 17:15:52.677058 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:52.677018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-d2b2t" event={"ID":"2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc","Type":"ContainerStarted","Data":"86c9d48f048005f46ad51f03af240d9c91ed01db9fb0f11039901a2efaf5d20b"} Aug 05 17:15:55.665276 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:55.665201 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b86dd784c-4qpwg" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerName="console" containerID="cri-o://0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996" gracePeriod=15 Aug 05 17:15:55.955963 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:55.955932 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:56.089100 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089062 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089100 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089108 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089139 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089197 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089239 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089575 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089373 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76hpz\" (UniqueName: \"kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz\") pod \"1dbe1340-a228-4ae8-bd56-e6044b423945\" (UID: \"1dbe1340-a228-4ae8-bd56-e6044b423945\") " Aug 05 17:15:56.089805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089652 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:56.089973 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089666 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config" (OuterVolumeSpecName: "console-config") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:56.089973 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089674 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:56.090146 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.089864 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:56.091385 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.091355 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:56.091512 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.091381 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:56.091577 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.091553 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz" (OuterVolumeSpecName: "kube-api-access-76hpz") pod "1dbe1340-a228-4ae8-bd56-e6044b423945" (UID: "1dbe1340-a228-4ae8-bd56-e6044b423945"). InnerVolumeSpecName "kube-api-access-76hpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190260 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-service-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190288 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190298 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190307 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-oauth-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190316 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbe1340-a228-4ae8-bd56-e6044b423945-console-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190324 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76hpz\" (UniqueName: \"kubernetes.io/projected/1dbe1340-a228-4ae8-bd56-e6044b423945-kube-api-access-76hpz\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.190341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.190332 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbe1340-a228-4ae8-bd56-e6044b423945-console-oauth-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:15:56.699644 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.699607 2579 generic.go:356] "Generic (PLEG): container finished" podID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerID="0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996" exitCode=0 Aug 05 17:15:56.700051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.699650 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86dd784c-4qpwg" Aug 05 17:15:56.700051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.699693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86dd784c-4qpwg" event={"ID":"1dbe1340-a228-4ae8-bd56-e6044b423945","Type":"ContainerDied","Data":"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996"} Aug 05 17:15:56.700051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.699746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86dd784c-4qpwg" event={"ID":"1dbe1340-a228-4ae8-bd56-e6044b423945","Type":"ContainerDied","Data":"d9411ea4062752263d6700ab2b9f71532d4b01664fd072eacdecc4f61e8be8d8"} Aug 05 17:15:56.700051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.699766 2579 scope.go:117] "RemoveContainer" containerID="0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996" Aug 05 17:15:56.708485 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.708404 2579 scope.go:117] "RemoveContainer" containerID="0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996" Aug 05 17:15:56.708756 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:15:56.708739 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996\": container with ID starting with 0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996 not found: ID does not exist" containerID="0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996" Aug 05 17:15:56.708818 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.708764 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996"} err="failed to get container status \"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996\": rpc error: code = NotFound desc = could not find container \"0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996\": container with ID starting with 0b1f31d7e88981d2f13677bf785e921924dbb2ca2222c80644ebd9001b6c4996 not found: ID does not exist" Aug 05 17:15:56.722496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.722463 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:56.729508 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:56.729478 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b86dd784c-4qpwg"] Aug 05 17:15:57.906390 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:15:57.906355 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" path="/var/lib/kubelet/pods/1dbe1340-a228-4ae8-bd56-e6044b423945/volumes" Aug 05 17:16:22.111370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:22.111333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:22.127094 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:22.127067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:22.825894 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:22.825869 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:35.946286 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946255 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:35.946694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946544 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="alertmanager" containerID="cri-o://0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" gracePeriod=120 Aug 05 17:16:35.946694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946595 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-metric" containerID="cri-o://3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" gracePeriod=120 Aug 05 17:16:35.946694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946635 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="prom-label-proxy" containerID="cri-o://53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" gracePeriod=120 Aug 05 17:16:35.946875 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946680 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="config-reloader" containerID="cri-o://df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" gracePeriod=120 Aug 05 17:16:35.946875 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946732 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy" containerID="cri-o://991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" gracePeriod=120 Aug 05 17:16:35.946875 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:35.946814 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-web" containerID="cri-o://e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" gracePeriod=120 Aug 05 17:16:36.865664 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865631 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" exitCode=0 Aug 05 17:16:36.865664 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865657 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" exitCode=0 Aug 05 17:16:36.865664 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865664 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" exitCode=0 Aug 05 17:16:36.865664 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865671 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" exitCode=0 Aug 05 17:16:36.865932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2"} Aug 05 17:16:36.865932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45"} Aug 05 17:16:36.865932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564"} Aug 05 17:16:36.865932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:36.865821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a"} Aug 05 17:16:37.185814 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.185790 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:37.254310 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254231 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254310 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254296 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254333 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254363 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254419 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254443 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254779 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254555 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:37.254831 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254814 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:37.254831 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254819 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:37.254932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254814 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254866 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254900 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.254932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254928 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.255147 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.254957 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.255147 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.255010 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.255147 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.255047 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2snr\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr\") pod \"97c1444e-43f4-499f-a027-56931d931b63\" (UID: \"97c1444e-43f4-499f-a027-56931d931b63\") " Aug 05 17:16:37.255654 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.255329 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-main-db\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.255654 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.255354 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.255654 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.255371 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97c1444e-43f4-499f-a027-56931d931b63-metrics-client-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.257940 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.257865 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out" (OuterVolumeSpecName: "config-out") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:37.258051 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.258005 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.258149 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.258120 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume" (OuterVolumeSpecName: "config-volume") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.258449 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.258401 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.259149 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.259123 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr" (OuterVolumeSpecName: "kube-api-access-h2snr") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "kube-api-access-h2snr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:37.259649 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.259619 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.259830 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.259809 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:37.259970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.259941 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.262269 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.262244 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.270686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.270655 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config" (OuterVolumeSpecName: "web-config") pod "97c1444e-43f4-499f-a027-56931d931b63" (UID: "97c1444e-43f4-499f-a027-56931d931b63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:37.356255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356217 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97c1444e-43f4-499f-a027-56931d931b63-config-out\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356249 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-web-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356260 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-cluster-tls-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356255 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356270 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-main-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356279 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356289 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-tls-assets\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356298 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356306 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356316 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97c1444e-43f4-499f-a027-56931d931b63-config-volume\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.356544 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.356325 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2snr\" (UniqueName: \"kubernetes.io/projected/97c1444e-43f4-499f-a027-56931d931b63-kube-api-access-h2snr\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:37.872428 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872365 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" exitCode=0 Aug 05 17:16:37.872428 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872397 2579 generic.go:356] "Generic (PLEG): container finished" podID="97c1444e-43f4-499f-a027-56931d931b63" containerID="e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" exitCode=0 Aug 05 17:16:37.872627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c"} Aug 05 17:16:37.872627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872470 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:37.872627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de"} Aug 05 17:16:37.872627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97c1444e-43f4-499f-a027-56931d931b63","Type":"ContainerDied","Data":"215321449f567a6a4e95cdfd6a9c4b72b2a73173e7e985017ba1e621d154cccf"} Aug 05 17:16:37.872627 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.872597 2579 scope.go:117] "RemoveContainer" containerID="53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" Aug 05 17:16:37.887657 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.887632 2579 scope.go:117] "RemoveContainer" containerID="3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" Aug 05 17:16:37.895278 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.895255 2579 scope.go:117] "RemoveContainer" containerID="991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" Aug 05 17:16:37.903085 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.903016 2579 scope.go:117] "RemoveContainer" containerID="e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" Aug 05 17:16:37.907269 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.907247 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:37.908868 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.908843 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:37.911087 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.911069 2579 scope.go:117] "RemoveContainer" containerID="df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" Aug 05 17:16:37.918115 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.918097 2579 scope.go:117] "RemoveContainer" containerID="0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" Aug 05 17:16:37.925576 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.925557 2579 scope.go:117] "RemoveContainer" containerID="cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a" Aug 05 17:16:37.932844 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.932824 2579 scope.go:117] "RemoveContainer" containerID="53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" Aug 05 17:16:37.933106 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.933083 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2\": container with ID starting with 53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2 not found: ID does not exist" containerID="53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" Aug 05 17:16:37.933184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933115 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2"} err="failed to get container status \"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2\": rpc error: code = NotFound desc = could not find container \"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2\": container with ID starting with 53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2 not found: ID does not exist" Aug 05 17:16:37.933184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933135 2579 scope.go:117] "RemoveContainer" containerID="3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" Aug 05 17:16:37.933364 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.933347 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c\": container with ID starting with 3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c not found: ID does not exist" containerID="3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" Aug 05 17:16:37.933430 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933369 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c"} err="failed to get container status \"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c\": rpc error: code = NotFound desc = could not find container \"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c\": container with ID starting with 3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c not found: ID does not exist" Aug 05 17:16:37.933430 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933383 2579 scope.go:117] "RemoveContainer" containerID="991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" Aug 05 17:16:37.933639 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.933622 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45\": container with ID starting with 991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45 not found: ID does not exist" containerID="991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" Aug 05 17:16:37.933677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933645 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45"} err="failed to get container status \"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45\": rpc error: code = NotFound desc = could not find container \"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45\": container with ID starting with 991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45 not found: ID does not exist" Aug 05 17:16:37.933677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933661 2579 scope.go:117] "RemoveContainer" containerID="e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" Aug 05 17:16:37.933866 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.933850 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de\": container with ID starting with e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de not found: ID does not exist" containerID="e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" Aug 05 17:16:37.933911 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933869 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de"} err="failed to get container status \"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de\": rpc error: code = NotFound desc = could not find container \"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de\": container with ID starting with e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de not found: ID does not exist" Aug 05 17:16:37.933911 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.933882 2579 scope.go:117] "RemoveContainer" containerID="df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" Aug 05 17:16:37.934107 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.934090 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564\": container with ID starting with df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564 not found: ID does not exist" containerID="df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" Aug 05 17:16:37.934146 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934113 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564"} err="failed to get container status \"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564\": rpc error: code = NotFound desc = could not find container \"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564\": container with ID starting with df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564 not found: ID does not exist" Aug 05 17:16:37.934146 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934128 2579 scope.go:117] "RemoveContainer" containerID="0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" Aug 05 17:16:37.934336 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.934321 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a\": container with ID starting with 0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a not found: ID does not exist" containerID="0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" Aug 05 17:16:37.934379 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934341 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a"} err="failed to get container status \"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a\": rpc error: code = NotFound desc = could not find container \"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a\": container with ID starting with 0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a not found: ID does not exist" Aug 05 17:16:37.934379 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934355 2579 scope.go:117] "RemoveContainer" containerID="cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a" Aug 05 17:16:37.934591 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:37.934575 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a\": container with ID starting with cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a not found: ID does not exist" containerID="cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a" Aug 05 17:16:37.934632 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934594 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a"} err="failed to get container status \"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a\": rpc error: code = NotFound desc = could not find container \"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a\": container with ID starting with cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a not found: ID does not exist" Aug 05 17:16:37.934632 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934608 2579 scope.go:117] "RemoveContainer" containerID="53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2" Aug 05 17:16:37.934821 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934806 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2"} err="failed to get container status \"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2\": rpc error: code = NotFound desc = could not find container \"53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2\": container with ID starting with 53088415971c9668e23317c9cacb8fc008833cdb2abbe67249b820a3786d0dc2 not found: ID does not exist" Aug 05 17:16:37.934862 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934822 2579 scope.go:117] "RemoveContainer" containerID="3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c" Aug 05 17:16:37.935022 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.934992 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c"} err="failed to get container status \"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c\": rpc error: code = NotFound desc = could not find container \"3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c\": container with ID starting with 3bd8b4f1d320cd2eb4108f1452fa5bbd4b63dd0f4a55979777495bb9c434585c not found: ID does not exist" Aug 05 17:16:37.935062 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935024 2579 scope.go:117] "RemoveContainer" containerID="991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45" Aug 05 17:16:37.935218 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935201 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45"} err="failed to get container status \"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45\": rpc error: code = NotFound desc = could not find container \"991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45\": container with ID starting with 991c9718dcd87db9685040e8729a96e4d093684d0256ae274c3d943ce7941e45 not found: ID does not exist" Aug 05 17:16:37.935264 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935219 2579 scope.go:117] "RemoveContainer" containerID="e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de" Aug 05 17:16:37.935401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935386 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de"} err="failed to get container status \"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de\": rpc error: code = NotFound desc = could not find container \"e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de\": container with ID starting with e8c8e7072d2ea09f89e59c145a5b8d39266d2cb7e5f99a83cf3ac46d848194de not found: ID does not exist" Aug 05 17:16:37.935471 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935401 2579 scope.go:117] "RemoveContainer" containerID="df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564" Aug 05 17:16:37.935658 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935641 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564"} err="failed to get container status \"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564\": rpc error: code = NotFound desc = could not find container \"df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564\": container with ID starting with df43ab3fb5a1c03a0e795a9ec1483e4c88660d24620ae6dd0eea6eb3659c0564 not found: ID does not exist" Aug 05 17:16:37.935698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935658 2579 scope.go:117] "RemoveContainer" containerID="0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a" Aug 05 17:16:37.935877 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935856 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a"} err="failed to get container status \"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a\": rpc error: code = NotFound desc = could not find container \"0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a\": container with ID starting with 0fbe07b0d2b37a91ce42409c46603308eb0828fbd0ffd0f7b1450ad4b5a9240a not found: ID does not exist" Aug 05 17:16:37.935919 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.935878 2579 scope.go:117] "RemoveContainer" containerID="cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a" Aug 05 17:16:37.936071 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.936056 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a"} err="failed to get container status \"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a\": rpc error: code = NotFound desc = could not find container \"cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a\": container with ID starting with cc9e7e2a77905abafd37f3a631c270a87f09cf96859f87ad08c27da7e447e34a not found: ID does not exist" Aug 05 17:16:37.941176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941156 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:37.941461 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941449 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="init-config-reloader" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941463 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="init-config-reloader" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941473 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941488 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="alertmanager" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941493 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="alertmanager" Aug 05 17:16:37.941501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941501 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="prom-label-proxy" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941507 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="prom-label-proxy" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941517 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941522 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941531 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="config-reloader" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941536 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="config-reloader" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941543 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-metric" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941548 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-metric" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941558 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941562 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941568 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-web" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941573 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-web" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941624 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbe1340-a228-4ae8-bd56-e6044b423945" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941630 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-web" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941638 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941645 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="config-reloader" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941650 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="prom-label-proxy" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941655 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="alertmanager" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941661 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="035f5d21-c87a-4a53-8778-7d9b6d75cf18" containerName="console" Aug 05 17:16:37.941666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.941665 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c1444e-43f4-499f-a027-56931d931b63" containerName="kube-rbac-proxy-metric" Aug 05 17:16:37.945107 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.945092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:37.949319 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.949295 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 05 17:16:37.949440 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.949325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 05 17:16:37.949766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.949750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 05 17:16:37.949843 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.949770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mg9f5\"" Aug 05 17:16:37.950068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.950051 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 05 17:16:37.950068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.950068 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 05 17:16:37.950214 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.950071 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 05 17:16:37.950214 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.950054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 05 17:16:37.953304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.953282 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 05 17:16:37.956483 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.956465 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 05 17:16:37.965099 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:37.965077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:38.063958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.063925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.063958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.063960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.063979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.063994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs8pl\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-kube-api-access-bs8pl\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.064454 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.064319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.164926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.164967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.164992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165017 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs8pl\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-kube-api-access-bs8pl\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165334 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165745 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165745 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.165959 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.165934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168113 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-out\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168472 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168688 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168668 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168887 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.168950 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.168932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.170373 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.170352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-web-config\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.175995 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.175973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs8pl\" (UniqueName: \"kubernetes.io/projected/2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3-kube-api-access-bs8pl\") pod \"alertmanager-main-0\" (UID: \"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.255220 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.255177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:16:38.403448 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.403399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:16:38.409453 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:16:38.409426 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2571aaf6_d4ce_41ef_8b6d_794c2a8c53c3.slice/crio-a1be4efc62914ccf2baf067f344e5833c5eb7d1c720555fc37ea117044f720f2 WatchSource:0}: Error finding container a1be4efc62914ccf2baf067f344e5833c5eb7d1c720555fc37ea117044f720f2: Status 404 returned error can't find the container with id a1be4efc62914ccf2baf067f344e5833c5eb7d1c720555fc37ea117044f720f2 Aug 05 17:16:38.878341 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.878302 2579 generic.go:356] "Generic (PLEG): container finished" podID="2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3" containerID="510f071fc21907ebfaaa086b5f4660aa5ecb00c0cc7aa3a35a8870a58c9a7f29" exitCode=0 Aug 05 17:16:38.878526 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.878387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerDied","Data":"510f071fc21907ebfaaa086b5f4660aa5ecb00c0cc7aa3a35a8870a58c9a7f29"} Aug 05 17:16:38.878526 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:38.878485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"a1be4efc62914ccf2baf067f344e5833c5eb7d1c720555fc37ea117044f720f2"} Aug 05 17:16:39.887284 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"d211c85a1ee421024ca40bb8e5793c0464580414df055c01428571e0e77629e8"} Aug 05 17:16:39.887698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"4a9d5e877ab7043acf19428316e0f03b63050928cf805397653e3ec712609727"} Aug 05 17:16:39.887698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"7692a2dc16e5cd1b84e5643924ff07df4371f612ce2744dd2089ad910799ee9d"} Aug 05 17:16:39.887698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"f493b17f1c9ef9df8736f4a810bef62a4c2253dc3fe920485de43ba8ca11622c"} Aug 05 17:16:39.887698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"2a227f74d69a70bbf2ac3486706ad7325e94d66188da7c821f3b0a92c440ee01"} Aug 05 17:16:39.887698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.887542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3","Type":"ContainerStarted","Data":"f28fc61e133bf6ee7cb745ef5b04b2650f86bb12e8a68d48ea38dec1ab5c8c24"} Aug 05 17:16:39.907325 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.907280 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c1444e-43f4-499f-a027-56931d931b63" path="/var/lib/kubelet/pods/97c1444e-43f4-499f-a027-56931d931b63/volumes" Aug 05 17:16:39.929670 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.929618 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.914328413 podStartE2EDuration="2.929600839s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.272426ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:39.928049014 +0000 UTC m=+248.590785674" watchObservedRunningTime="2026-08-05 17:16:39.929600839 +0000 UTC m=+248.592337499" Aug 05 17:16:39.983553 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.983523 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f68859756-gvfbb"] Aug 05 17:16:39.986333 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.986294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:39.990976 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.990956 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 05 17:16:39.991115 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.990953 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 05 17:16:39.991115 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.991020 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 05 17:16:39.991373 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.991354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-chd2c\"" Aug 05 17:16:39.991678 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.991653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 05 17:16:39.991834 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.991737 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 05 17:16:39.998726 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:39.998549 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 05 17:16:40.006368 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.006340 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f68859756-gvfbb"] Aug 05 17:16:40.082455 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-federate-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082455 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-serving-certs-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082703 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082703 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbsqf\" (UniqueName: \"kubernetes.io/projected/2a59ecea-426a-452d-8451-95c9d91b6d97-kube-api-access-qbsqf\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082703 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-metrics-client-ca\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082703 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082703 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.082909 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.082736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.183800 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.183704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.183800 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.183761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184009 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.183874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184009 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.183945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-federate-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184009 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.183983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-serving-certs-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184009 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184282 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbsqf\" (UniqueName: \"kubernetes.io/projected/2a59ecea-426a-452d-8451-95c9d91b6d97-kube-api-access-qbsqf\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184282 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-metrics-client-ca\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184829 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-serving-certs-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184957 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.184957 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.184867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a59ecea-426a-452d-8451-95c9d91b6d97-metrics-client-ca\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.186528 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.186504 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.186613 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.186564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-secret-telemeter-client\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.186663 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.186631 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-telemeter-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.186824 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.186808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2a59ecea-426a-452d-8451-95c9d91b6d97-federate-client-tls\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.195929 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.195904 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbsqf\" (UniqueName: \"kubernetes.io/projected/2a59ecea-426a-452d-8451-95c9d91b6d97-kube-api-access-qbsqf\") pod \"telemeter-client-5f68859756-gvfbb\" (UID: \"2a59ecea-426a-452d-8451-95c9d91b6d97\") " pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.298366 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.298332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" Aug 05 17:16:40.312598 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.312570 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:40.312923 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.312893 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="prometheus" containerID="cri-o://45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" gracePeriod=600 Aug 05 17:16:40.313026 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.312919 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy" containerID="cri-o://ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" gracePeriod=600 Aug 05 17:16:40.313026 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.312945 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-thanos" containerID="cri-o://86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" gracePeriod=600 Aug 05 17:16:40.313139 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.313047 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="thanos-sidecar" containerID="cri-o://f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" gracePeriod=600 Aug 05 17:16:40.313139 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.313065 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="config-reloader" containerID="cri-o://17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" gracePeriod=600 Aug 05 17:16:40.313139 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.313120 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-web" containerID="cri-o://512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" gracePeriod=600 Aug 05 17:16:40.473398 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.473374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f68859756-gvfbb"] Aug 05 17:16:40.475087 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:16:40.475055 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a59ecea_426a_452d_8451_95c9d91b6d97.slice/crio-2d5acbd2a6cab1fafac80287098181b26a8d92a73e382a89e66f37432a26e334 WatchSource:0}: Error finding container 2d5acbd2a6cab1fafac80287098181b26a8d92a73e382a89e66f37432a26e334: Status 404 returned error can't find the container with id 2d5acbd2a6cab1fafac80287098181b26a8d92a73e382a89e66f37432a26e334 Aug 05 17:16:40.581548 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.581521 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:40.690926 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690850 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.690926 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.690926 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690909 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690927 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690957 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.690986 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691024 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691048 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691092 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691117 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691166 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691154 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691189 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691230 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691254 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691300 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691295 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691326 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691342 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691349 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691398 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cr65\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691396 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691465 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691494 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5303631a-7792-48e7-bf16-d25aa3760348\" (UID: \"5303631a-7792-48e7-bf16-d25aa3760348\") " Aug 05 17:16:40.691571 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691560 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.692206 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691824 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.692206 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691845 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-metrics-client-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.692206 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691860 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.692206 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.691875 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.692401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.692332 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.693896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.693343 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:40.693896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.693607 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.693896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.693671 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:40.693896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.693676 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.693896 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.693818 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config" (OuterVolumeSpecName: "config") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.694229 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.694013 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.694749 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.694377 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.694749 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.694720 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:40.695217 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.695181 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.696108 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.696080 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65" (OuterVolumeSpecName: "kube-api-access-6cr65") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "kube-api-access-6cr65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:40.696209 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.696123 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.696456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.696434 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out" (OuterVolumeSpecName: "config-out") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:40.696456 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.696437 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.696633 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.696545 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.704776 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.704754 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config" (OuterVolumeSpecName: "web-config") pod "5303631a-7792-48e7-bf16-d25aa3760348" (UID: "5303631a-7792-48e7-bf16-d25aa3760348"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:40.793256 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793220 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-tls-assets\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793256 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793250 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793256 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793259 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793269 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-kube-rbac-proxy\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793277 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793286 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-metrics-client-certs\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793297 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-db\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793306 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5303631a-7792-48e7-bf16-d25aa3760348-config-out\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793314 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793322 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793332 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793342 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5303631a-7792-48e7-bf16-d25aa3760348-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793351 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-web-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793360 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cr65\" (UniqueName: \"kubernetes.io/projected/5303631a-7792-48e7-bf16-d25aa3760348-kube-api-access-6cr65\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793367 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-grpc-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.793510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.793376 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5303631a-7792-48e7-bf16-d25aa3760348-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:16:40.894655 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894624 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" exitCode=0 Aug 05 17:16:40.894655 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894648 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" exitCode=0 Aug 05 17:16:40.894655 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894654 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" exitCode=0 Aug 05 17:16:40.894655 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894660 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" exitCode=0 Aug 05 17:16:40.894655 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894665 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" exitCode=0 Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894670 2579 generic.go:356] "Generic (PLEG): container finished" podID="5303631a-7792-48e7-bf16-d25aa3760348" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" exitCode=0 Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894707 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894969 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.895247 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.894934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} Aug 05 17:16:40.895538 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.895476 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} Aug 05 17:16:40.895586 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.895548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} Aug 05 17:16:40.895633 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.895608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} Aug 05 17:16:40.896312 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.895934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5303631a-7792-48e7-bf16-d25aa3760348","Type":"ContainerDied","Data":"9a369f83b0b0d278afe2694aaaa368d8615162466970a7dd4b7de37e87e5a45a"} Aug 05 17:16:40.901757 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.899510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" event={"ID":"2a59ecea-426a-452d-8451-95c9d91b6d97","Type":"ContainerStarted","Data":"2d5acbd2a6cab1fafac80287098181b26a8d92a73e382a89e66f37432a26e334"} Aug 05 17:16:40.911036 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.911016 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.917812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.917793 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.924497 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.924474 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.930694 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.930668 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.937151 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.937062 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:40.937200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.937168 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.942690 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.942646 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:40.944666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.944650 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.951131 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951115 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.951496 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.951386 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.951496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951427 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.951496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951445 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.951689 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.951672 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.951721 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951695 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.951721 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951711 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.951948 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.951931 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.952003 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951952 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.952003 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.951969 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.952173 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.952157 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.952213 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952177 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.952213 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952192 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.952450 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.952434 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.952520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952454 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.952520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952467 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.952721 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.952696 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.952766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952731 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.952766 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.952753 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.953012 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:16:40.952994 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.953070 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953013 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.953070 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953033 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.953251 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953231 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.953299 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953259 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.953890 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953870 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.953967 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.953892 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.954122 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954104 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.954174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954123 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.954350 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954332 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.954496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954351 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.954650 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954632 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.954698 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954652 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.954872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954856 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.954916 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.954872 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.955088 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955065 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.955088 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955088 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.955314 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955268 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.955314 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955282 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.955595 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955569 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.955595 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955596 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.955867 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955842 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.955932 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.955868 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.956078 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956058 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.956116 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956079 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.956324 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956305 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.956324 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956323 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.956553 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956533 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.956632 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956555 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.956792 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956775 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.956846 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.956793 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.957044 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957022 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.957088 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957045 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.957250 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957232 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.957330 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957252 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.957474 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957457 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.957519 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957475 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.957684 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957667 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.957753 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957686 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.957925 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957907 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.957986 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.957928 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.958163 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958146 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.958214 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958163 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.958434 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958398 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.958496 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958435 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.958683 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958662 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.958761 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958685 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.958947 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958929 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.958995 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.958948 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.959198 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959177 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.959265 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959199 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.959436 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959397 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.959495 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959436 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.959643 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959626 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.959686 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959644 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.959854 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959838 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.959912 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.959856 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.960065 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960038 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.960065 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960065 2579 scope.go:117] "RemoveContainer" containerID="86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34" Aug 05 17:16:40.960273 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960257 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34"} err="failed to get container status \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": rpc error: code = NotFound desc = could not find container \"86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34\": container with ID starting with 86857891796c5b5d45a2536c7183196e612694ecc3965451db27ce1669881a34 not found: ID does not exist" Aug 05 17:16:40.960314 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960273 2579 scope.go:117] "RemoveContainer" containerID="ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad" Aug 05 17:16:40.960493 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960469 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad"} err="failed to get container status \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": rpc error: code = NotFound desc = could not find container \"ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad\": container with ID starting with ce04dc083a1a112877eb2082a88ed981bb46d4c1a88cc46cb2420231c89ac4ad not found: ID does not exist" Aug 05 17:16:40.960538 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960496 2579 scope.go:117] "RemoveContainer" containerID="512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8" Aug 05 17:16:40.960708 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960691 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8"} err="failed to get container status \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": rpc error: code = NotFound desc = could not find container \"512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8\": container with ID starting with 512e495fd58dd97822c6b40259dbfe6d75060b9131e2b7917cdb234ebc2562b8 not found: ID does not exist" Aug 05 17:16:40.960769 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960709 2579 scope.go:117] "RemoveContainer" containerID="f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101" Aug 05 17:16:40.960910 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960895 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101"} err="failed to get container status \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": rpc error: code = NotFound desc = could not find container \"f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101\": container with ID starting with f7d7c46040f75202ba5da3b4447ea219ef199dce5d2af28cc767f152c79f5101 not found: ID does not exist" Aug 05 17:16:40.960910 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.960910 2579 scope.go:117] "RemoveContainer" containerID="17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7" Aug 05 17:16:40.961142 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.961123 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7"} err="failed to get container status \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": rpc error: code = NotFound desc = could not find container \"17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7\": container with ID starting with 17382ae861592c51b93b4f27d932143c11bae7c088dc8568bf366a842c226fe7 not found: ID does not exist" Aug 05 17:16:40.961186 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.961144 2579 scope.go:117] "RemoveContainer" containerID="45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38" Aug 05 17:16:40.961391 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.961373 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38"} err="failed to get container status \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": rpc error: code = NotFound desc = could not find container \"45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38\": container with ID starting with 45cec6126f6f13289deff603c69592564e41d0645cff21ed234fecfe2f22ac38 not found: ID does not exist" Aug 05 17:16:40.961472 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.961393 2579 scope.go:117] "RemoveContainer" containerID="80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115" Aug 05 17:16:40.961699 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.961679 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115"} err="failed to get container status \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": rpc error: code = NotFound desc = could not find container \"80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115\": container with ID starting with 80ade1c7d93d5c91201bed3f5c8463c8d362d63544596367b3c6a5fb48cae115 not found: ID does not exist" Aug 05 17:16:40.989286 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989252 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:40.989605 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989589 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="init-config-reloader" Aug 05 17:16:40.989605 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989605 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="init-config-reloader" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989616 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="config-reloader" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989624 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="config-reloader" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989634 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989640 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989649 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="prometheus" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989657 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="prometheus" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989667 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-web" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989673 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-web" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989680 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="thanos-sidecar" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989687 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="thanos-sidecar" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989692 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:40.989730 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989697 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989753 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989764 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="prometheus" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989775 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-web" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989782 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="config-reloader" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989788 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="thanos-sidecar" Aug 05 17:16:40.990170 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.989794 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303631a-7792-48e7-bf16-d25aa3760348" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:40.993683 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:40.993661 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.006822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.006795 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 17:16:41.007030 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.007011 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 17:16:41.007030 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.007024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 17:16:41.007697 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.007679 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 17:16:41.008156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.008125 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 17:16:41.008783 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.008637 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 17:16:41.008982 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.008882 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 17:16:41.009264 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009245 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 17:16:41.009479 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 17:16:41.009587 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9kh9mr2s9i29u\"" Aug 05 17:16:41.009757 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 17:16:41.009918 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009903 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-npxht\"" Aug 05 17:16:41.010036 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.009749 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 17:16:41.010150 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.010052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 17:16:41.010553 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.010535 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 17:16:41.014028 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.014011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 17:16:41.015851 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.015828 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 17:16:41.017392 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.017373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:41.095779 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.095970 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.095933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfg8v\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-kube-api-access-tfg8v\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096174 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096328 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096529 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.096529 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.096347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197294 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197294 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197294 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.197543 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfg8v\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-kube-api-access-tfg8v\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.197953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.198522 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.198313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.199204 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.198963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.201016 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.200602 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.201016 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.200980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.201184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.201107 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.201184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.201160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.201364 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.201337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.202176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.201581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.202176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.201608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.202176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.202135 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.202382 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.202312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.202854 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.202822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.203018 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.202987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.203470 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.203444 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.203630 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.203613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.203743 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.203719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb115ac-b60b-4a10-8f2b-29e64ea8046a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.204373 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.204353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb115ac-b60b-4a10-8f2b-29e64ea8046a-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.204931 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.204914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb115ac-b60b-4a10-8f2b-29e64ea8046a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.209118 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.209098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfg8v\" (UniqueName: \"kubernetes.io/projected/deb115ac-b60b-4a10-8f2b-29e64ea8046a-kube-api-access-tfg8v\") pod \"prometheus-k8s-0\" (UID: \"deb115ac-b60b-4a10-8f2b-29e64ea8046a\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.303593 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.303551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:41.476579 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.476325 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:41.479327 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:16:41.479302 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb115ac_b60b_4a10_8f2b_29e64ea8046a.slice/crio-55efbde8a8ac419d215b25145a691d56e38923774bc98fa5a113408d04960018 WatchSource:0}: Error finding container 55efbde8a8ac419d215b25145a691d56e38923774bc98fa5a113408d04960018: Status 404 returned error can't find the container with id 55efbde8a8ac419d215b25145a691d56e38923774bc98fa5a113408d04960018 Aug 05 17:16:41.905953 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.905911 2579 generic.go:356] "Generic (PLEG): container finished" podID="deb115ac-b60b-4a10-8f2b-29e64ea8046a" containerID="cdac398ff2dccb602dd6233a7fd9fb27c20c997bcb0bcad73441bfce7555a7db" exitCode=0 Aug 05 17:16:41.907340 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.907308 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5303631a-7792-48e7-bf16-d25aa3760348" path="/var/lib/kubelet/pods/5303631a-7792-48e7-bf16-d25aa3760348/volumes" Aug 05 17:16:41.907937 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.907913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerDied","Data":"cdac398ff2dccb602dd6233a7fd9fb27c20c997bcb0bcad73441bfce7555a7db"} Aug 05 17:16:41.908018 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:41.907972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"55efbde8a8ac419d215b25145a691d56e38923774bc98fa5a113408d04960018"} Aug 05 17:16:42.912710 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912669 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"0e4489196ab237bd7b297a10d0656684cb01d7517acef9e83e506b5d0ad3275f"} Aug 05 17:16:42.913156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"68cd53eb3d1c611c2e755d6fdbf9955ab5fcec2c7a624dba20cc5852d57e8b8e"} Aug 05 17:16:42.913156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"76b1c5dc2aa4155426714c2a26eb3288d71ffd5742e2e0f638f559698d9f93b6"} Aug 05 17:16:42.913156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"5b3978217037172d3ac68681d698735880a41d7d9a3e0e960a11f4fda7ac529b"} Aug 05 17:16:42.913156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"a1472cddd5ba88effa5cd3ed8dd65a85ba2f744e588460843cd0563080bf90d2"} Aug 05 17:16:42.913156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.912936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb115ac-b60b-4a10-8f2b-29e64ea8046a","Type":"ContainerStarted","Data":"07ec409c5358fb277d08a207748473ca21ea12101d6a9558c64d99b18b6a2521"} Aug 05 17:16:42.914851 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.914824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" event={"ID":"2a59ecea-426a-452d-8451-95c9d91b6d97","Type":"ContainerStarted","Data":"dcad116b66fcc029e8c621198c9430e317f25ede09588564f7579e923d852a4f"} Aug 05 17:16:42.914967 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.914883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" event={"ID":"2a59ecea-426a-452d-8451-95c9d91b6d97","Type":"ContainerStarted","Data":"96d17c2c33a4535f6c1fb48fd3c757fe7287d175bfad70a005210c73f34e70b6"} Aug 05 17:16:42.914967 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.914917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" event={"ID":"2a59ecea-426a-452d-8451-95c9d91b6d97","Type":"ContainerStarted","Data":"4b6d22540a9a68ac4be9c87a8a698f674dac8e6ffb2d22c91134a658de56f5e9"} Aug 05 17:16:42.953829 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.953782 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.930968836 podStartE2EDuration="2.953766361s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.797525ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:42.951437108 +0000 UTC m=+251.614173789" watchObservedRunningTime="2026-08-05 17:16:42.953766361 +0000 UTC m=+251.616503021" Aug 05 17:16:42.984818 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:42.984712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f68859756-gvfbb" podStartSLOduration=1.977051848 podStartE2EDuration="3.984692659s" totalImagesPullingTime="2.007640811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:42.983630543 +0000 UTC m=+251.646367203" watchObservedRunningTime="2026-08-05 17:16:42.984692659 +0000 UTC m=+251.647429320" Aug 05 17:16:43.096290 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.096258 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:16:43.098536 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.098520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.117008 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.116976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:16:43.221177 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsd4\" (UniqueName: \"kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221370 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221618 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.221618 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.221484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsd4\" (UniqueName: \"kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322751 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322948 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.322948 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.322878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.323393 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.323358 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.323533 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.323451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.323533 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.323481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.323650 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.323633 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.325634 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.325608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.325831 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.325810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.334357 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.334335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsd4\" (UniqueName: \"kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4\") pod \"console-dd59ddfbd-rvpzs\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.407463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.407430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:43.547813 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.547772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:16:43.550623 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:16:43.550592 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb668d5_3c07_4f7a_b994_589b07ce14e3.slice/crio-b7831988f78439a1929efc72c58d179a10b6c72dc856e4c01341079255f602ed WatchSource:0}: Error finding container b7831988f78439a1929efc72c58d179a10b6c72dc856e4c01341079255f602ed: Status 404 returned error can't find the container with id b7831988f78439a1929efc72c58d179a10b6c72dc856e4c01341079255f602ed Aug 05 17:16:43.625510 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.625474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:16:43.627991 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.627968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d15ffe-a70c-4251-9109-15471c53c56f-metrics-certs\") pod \"network-metrics-daemon-rpbtn\" (UID: \"a4d15ffe-a70c-4251-9109-15471c53c56f\") " pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:16:43.805340 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.805307 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4hs5f\"" Aug 05 17:16:43.813305 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.813284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpbtn" Aug 05 17:16:43.921296 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.921258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd59ddfbd-rvpzs" event={"ID":"feb668d5-3c07-4f7a-b994-589b07ce14e3","Type":"ContainerStarted","Data":"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069"} Aug 05 17:16:43.921732 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.921318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd59ddfbd-rvpzs" event={"ID":"feb668d5-3c07-4f7a-b994-589b07ce14e3","Type":"ContainerStarted","Data":"b7831988f78439a1929efc72c58d179a10b6c72dc856e4c01341079255f602ed"} Aug 05 17:16:43.960477 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.960397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd59ddfbd-rvpzs" podStartSLOduration=0.960379753 podStartE2EDuration="960.379753ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:43.959060838 +0000 UTC m=+252.621797512" watchObservedRunningTime="2026-08-05 17:16:43.960379753 +0000 UTC m=+252.623116413" Aug 05 17:16:43.965006 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:43.964979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpbtn"] Aug 05 17:16:43.967971 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:16:43.967945 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d15ffe_a70c_4251_9109_15471c53c56f.slice/crio-520c614c993cfbe8168f88a852faf6df4ef90b463aae697b27043e0706765b1f WatchSource:0}: Error finding container 520c614c993cfbe8168f88a852faf6df4ef90b463aae697b27043e0706765b1f: Status 404 returned error can't find the container with id 520c614c993cfbe8168f88a852faf6df4ef90b463aae697b27043e0706765b1f Aug 05 17:16:44.927476 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:44.927443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpbtn" event={"ID":"a4d15ffe-a70c-4251-9109-15471c53c56f","Type":"ContainerStarted","Data":"520c614c993cfbe8168f88a852faf6df4ef90b463aae697b27043e0706765b1f"} Aug 05 17:16:45.932982 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:45.932947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpbtn" event={"ID":"a4d15ffe-a70c-4251-9109-15471c53c56f","Type":"ContainerStarted","Data":"eff9453e261abf0705d63f1fa658fffde08810ebbda70830efc51e4a2571b1cf"} Aug 05 17:16:45.933346 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:45.933002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpbtn" event={"ID":"a4d15ffe-a70c-4251-9109-15471c53c56f","Type":"ContainerStarted","Data":"1ff692a985e299f9fbfaa7ace2b2b1adf137d602e33ee32eccdfb2affaa26e07"} Aug 05 17:16:45.959869 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:45.959711 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rpbtn" podStartSLOduration=254.049940882 podStartE2EDuration="4m14.959690869s" totalImagesPullingTime="909.749987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:45.958144538 +0000 UTC m=+254.620881197" watchObservedRunningTime="2026-08-05 17:16:45.959690869 +0000 UTC m=+254.622427530" Aug 05 17:16:46.304585 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:46.304543 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.407740 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:53.407695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:53.408156 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:53.407770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:53.412737 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:53.412711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:53.972222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:53.972190 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:16:54.048440 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:16:54.045935 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:17:19.068315 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.068262 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-694d667859-rtflf" podUID="d0887375-8419-40a8-be9f-05798a57fe74" containerName="console" containerID="cri-o://8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe" gracePeriod=15 Aug 05 17:17:19.322937 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.322871 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:17:19.414941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.414900 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k657j\" (UniqueName: \"kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.414941 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.414956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415207 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.414975 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415207 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415002 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415207 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415031 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415207 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415065 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415450 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415262 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert\") pod \"d0887375-8419-40a8-be9f-05798a57fe74\" (UID: \"d0887375-8419-40a8-be9f-05798a57fe74\") " Aug 05 17:17:19.415592 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415553 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:17:19.415651 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415578 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config" (OuterVolumeSpecName: "console-config") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:17:19.415651 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415572 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:17:19.415718 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.415679 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:17:19.417159 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.417127 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j" (OuterVolumeSpecName: "kube-api-access-k657j") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "kube-api-access-k657j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:17:19.417268 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.417211 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:17:19.417268 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.417228 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0887375-8419-40a8-be9f-05798a57fe74" (UID: "d0887375-8419-40a8-be9f-05798a57fe74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:17:19.516609 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516556 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-service-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516609 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516605 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-oauth-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516609 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516619 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-oauth-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516861 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516632 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k657j\" (UniqueName: \"kubernetes.io/projected/d0887375-8419-40a8-be9f-05798a57fe74-kube-api-access-k657j\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516861 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516645 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-console-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516861 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516662 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0887375-8419-40a8-be9f-05798a57fe74-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:19.516861 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:19.516672 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0887375-8419-40a8-be9f-05798a57fe74-console-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:17:20.073147 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.073117 2579 generic.go:356] "Generic (PLEG): container finished" podID="d0887375-8419-40a8-be9f-05798a57fe74" containerID="8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe" exitCode=0 Aug 05 17:17:20.073537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.073161 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694d667859-rtflf" Aug 05 17:17:20.073537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.073195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694d667859-rtflf" event={"ID":"d0887375-8419-40a8-be9f-05798a57fe74","Type":"ContainerDied","Data":"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe"} Aug 05 17:17:20.073537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.073246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694d667859-rtflf" event={"ID":"d0887375-8419-40a8-be9f-05798a57fe74","Type":"ContainerDied","Data":"f10a22dbf9da34d8f83ebd5fcf13eac88337eb6f958487765beecec20e9dcc46"} Aug 05 17:17:20.073537 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.073271 2579 scope.go:117] "RemoveContainer" containerID="8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe" Aug 05 17:17:20.081680 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.081664 2579 scope.go:117] "RemoveContainer" containerID="8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe" Aug 05 17:17:20.081937 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:17:20.081918 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe\": container with ID starting with 8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe not found: ID does not exist" containerID="8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe" Aug 05 17:17:20.081986 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.081947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe"} err="failed to get container status \"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe\": rpc error: code = NotFound desc = could not find container \"8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe\": container with ID starting with 8ca62ddd08fbf185cf4c8cb7a4c75e2aa4a91500b16be43d737451157825d2fe not found: ID does not exist" Aug 05 17:17:20.090436 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.090398 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:17:20.094567 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:20.094544 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-694d667859-rtflf"] Aug 05 17:17:21.910596 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:21.908572 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0887375-8419-40a8-be9f-05798a57fe74" path="/var/lib/kubelet/pods/d0887375-8419-40a8-be9f-05798a57fe74/volumes" Aug 05 17:17:31.746127 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:31.746097 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:17:31.749910 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:31.749884 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:17:31.752862 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:31.752844 2579 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 17:17:41.304032 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:41.303996 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:41.319329 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:41.319302 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:42.176523 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:42.176498 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:57.023305 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.023268 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:17:57.023784 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.023615 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0887375-8419-40a8-be9f-05798a57fe74" containerName="console" Aug 05 17:17:57.023784 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.023628 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0887375-8419-40a8-be9f-05798a57fe74" containerName="console" Aug 05 17:17:57.023784 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.023690 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0887375-8419-40a8-be9f-05798a57fe74" containerName="console" Aug 05 17:17:57.026421 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.026390 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.044811 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.044784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:17:57.140783 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.140958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.140957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclkn\" (UniqueName: \"kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241753 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241753 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241955 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241955 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241955 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.241955 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclkn\" (UniqueName: \"kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.242164 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.241956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.242545 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.242499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.242653 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.242627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.242713 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.242693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.242756 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.242744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.244656 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.244623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.244744 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.244631 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.254596 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.254574 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclkn\" (UniqueName: \"kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn\") pod \"console-6d5d6c7ddd-7jr56\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.335547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.335481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:17:57.468283 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:57.468235 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:17:57.470352 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:17:57.470328 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad7b552_e221_47b1_8fae_fcb30abb5f5a.slice/crio-735eb7f18e02fd66f6f5869ba4ee09de0fe2d98cba367b83f9354dd70c8a04ff WatchSource:0}: Error finding container 735eb7f18e02fd66f6f5869ba4ee09de0fe2d98cba367b83f9354dd70c8a04ff: Status 404 returned error can't find the container with id 735eb7f18e02fd66f6f5869ba4ee09de0fe2d98cba367b83f9354dd70c8a04ff Aug 05 17:17:58.224911 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:58.224873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d6c7ddd-7jr56" event={"ID":"fad7b552-e221-47b1-8fae-fcb30abb5f5a","Type":"ContainerStarted","Data":"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26"} Aug 05 17:17:58.225296 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:58.224931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d6c7ddd-7jr56" event={"ID":"fad7b552-e221-47b1-8fae-fcb30abb5f5a","Type":"ContainerStarted","Data":"735eb7f18e02fd66f6f5869ba4ee09de0fe2d98cba367b83f9354dd70c8a04ff"} Aug 05 17:17:58.248786 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:17:58.248742 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5d6c7ddd-7jr56" podStartSLOduration=1.248726615 podStartE2EDuration="1.248726615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:17:58.247243596 +0000 UTC m=+326.909980256" watchObservedRunningTime="2026-08-05 17:17:58.248726615 +0000 UTC m=+326.911463337" Aug 05 17:18:07.336311 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:07.336275 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:18:07.336747 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:07.336332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:18:07.340928 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:07.340909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:18:08.271356 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:08.271327 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:18:08.332929 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:08.332890 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:18:33.354782 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.354688 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dd59ddfbd-rvpzs" podUID="feb668d5-3c07-4f7a-b994-589b07ce14e3" containerName="console" containerID="cri-o://0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069" gracePeriod=15 Aug 05 17:18:33.601119 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.601096 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:18:33.725964 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.725897 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.725964 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.725928 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.725964 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.725948 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.726222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.725974 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.726222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726201 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.726335 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726243 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdsd4\" (UniqueName: \"kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.726335 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726301 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config\") pod \"feb668d5-3c07-4f7a-b994-589b07ce14e3\" (UID: \"feb668d5-3c07-4f7a-b994-589b07ce14e3\") " Aug 05 17:18:33.726335 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726308 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:18:33.726566 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726361 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:18:33.726566 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726440 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:18:33.726695 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726675 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config" (OuterVolumeSpecName: "console-config") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:18:33.726769 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726754 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.726822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726772 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-service-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.726822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726780 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.726822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.726789 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/feb668d5-3c07-4f7a-b994-589b07ce14e3-oauth-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.728326 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.728304 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:18:33.728668 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.728650 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:18:33.728728 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.728674 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4" (OuterVolumeSpecName: "kube-api-access-rdsd4") pod "feb668d5-3c07-4f7a-b994-589b07ce14e3" (UID: "feb668d5-3c07-4f7a-b994-589b07ce14e3"). InnerVolumeSpecName "kube-api-access-rdsd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:18:33.827760 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.827723 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-oauth-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.827760 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.827757 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdsd4\" (UniqueName: \"kubernetes.io/projected/feb668d5-3c07-4f7a-b994-589b07ce14e3-kube-api-access-rdsd4\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:33.827760 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:33.827766 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/feb668d5-3c07-4f7a-b994-589b07ce14e3-console-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:18:34.369399 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.369361 2579 generic.go:356] "Generic (PLEG): container finished" podID="feb668d5-3c07-4f7a-b994-589b07ce14e3" containerID="0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069" exitCode=0 Aug 05 17:18:34.369812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.369430 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd59ddfbd-rvpzs" Aug 05 17:18:34.369812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.369432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd59ddfbd-rvpzs" event={"ID":"feb668d5-3c07-4f7a-b994-589b07ce14e3","Type":"ContainerDied","Data":"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069"} Aug 05 17:18:34.369812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.369481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd59ddfbd-rvpzs" event={"ID":"feb668d5-3c07-4f7a-b994-589b07ce14e3","Type":"ContainerDied","Data":"b7831988f78439a1929efc72c58d179a10b6c72dc856e4c01341079255f602ed"} Aug 05 17:18:34.369812 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.369508 2579 scope.go:117] "RemoveContainer" containerID="0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069" Aug 05 17:18:34.377931 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.377914 2579 scope.go:117] "RemoveContainer" containerID="0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069" Aug 05 17:18:34.378204 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:18:34.378183 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069\": container with ID starting with 0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069 not found: ID does not exist" containerID="0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069" Aug 05 17:18:34.378253 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.378212 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069"} err="failed to get container status \"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069\": rpc error: code = NotFound desc = could not find container \"0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069\": container with ID starting with 0676227af152b4adde135a75e6f9fc72fd3aac8d3f11f30d7dd9f42e3d36c069 not found: ID does not exist" Aug 05 17:18:34.386476 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.386456 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:18:34.393747 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:34.393725 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd59ddfbd-rvpzs"] Aug 05 17:18:35.906461 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:18:35.906424 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb668d5-3c07-4f7a-b994-589b07ce14e3" path="/var/lib/kubelet/pods/feb668d5-3c07-4f7a-b994-589b07ce14e3/volumes" Aug 05 17:22:31.775199 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:22:31.775164 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:22:31.775727 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:22:31.775450 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:27:31.800676 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:27:31.800595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:27:31.801295 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:27:31.801197 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:28:28.032346 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.032310 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:28:28.032907 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.032649 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb668d5-3c07-4f7a-b994-589b07ce14e3" containerName="console" Aug 05 17:28:28.032907 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.032662 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb668d5-3c07-4f7a-b994-589b07ce14e3" containerName="console" Aug 05 17:28:28.032907 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.032736 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb668d5-3c07-4f7a-b994-589b07ce14e3" containerName="console" Aug 05 17:28:28.035462 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.035445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.037745 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.037722 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-849e6-serving-cert\"" Aug 05 17:28:28.037876 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.037746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\"" Aug 05 17:28:28.037876 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.037721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:28:28.038443 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.038403 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-849e6-kube-rbac-proxy-sar-config\"" Aug 05 17:28:28.043356 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.043282 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:28:28.058144 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.058121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.058263 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.058160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.158805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.158772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.158805 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.158810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.159058 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:28:28.158942 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-849e6-serving-cert: secret "model-chainer-raw-849e6-serving-cert" not found Aug 05 17:28:28.159058 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:28:28.159043 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls podName:0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180 nodeName:}" failed. No retries permitted until 2026-08-05 17:28:28.659020789 +0000 UTC m=+957.321757429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls") pod "model-chainer-raw-849e6-d59cdc6c5-mbfqn" (UID: "0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180") : secret "model-chainer-raw-849e6-serving-cert" not found Aug 05 17:28:28.159388 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.159369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.662968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.662934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.665364 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.665335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") pod \"model-chainer-raw-849e6-d59cdc6c5-mbfqn\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:28.947122 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:28.947035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:29.074808 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:29.074786 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:28:29.077336 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:28:29.077309 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0c3c8f_dc2f_4fb5_9d50_07e55ddfb180.slice/crio-e1f4b8d6ad1f40573cc141ad312a7046fa3c18ea2a990a8ad1c6bead67e3dc09 WatchSource:0}: Error finding container e1f4b8d6ad1f40573cc141ad312a7046fa3c18ea2a990a8ad1c6bead67e3dc09: Status 404 returned error can't find the container with id e1f4b8d6ad1f40573cc141ad312a7046fa3c18ea2a990a8ad1c6bead67e3dc09 Aug 05 17:28:29.079208 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:29.079192 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:28:29.703935 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:29.703894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" event={"ID":"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180","Type":"ContainerStarted","Data":"e1f4b8d6ad1f40573cc141ad312a7046fa3c18ea2a990a8ad1c6bead67e3dc09"} Aug 05 17:28:31.716147 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:31.716056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" event={"ID":"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180","Type":"ContainerStarted","Data":"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b"} Aug 05 17:28:31.716531 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:31.716158 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:31.732678 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:31.732635 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podStartSLOduration=1.429726929 podStartE2EDuration="3.732621223s" totalImagesPullingTime="2.302894294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:31.73244495 +0000 UTC m=+960.395181607" watchObservedRunningTime="2026-08-05 17:28:31.732621223 +0000 UTC m=+960.395357912" Aug 05 17:28:37.725919 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:37.725888 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:38.098118 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:38.098086 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:28:38.098282 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:38.098255 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" containerID="cri-o://1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b" gracePeriod=30 Aug 05 17:28:42.723560 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:42.723515 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:28:47.723965 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:47.723923 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:28:52.723401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:52.723359 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:28:52.723826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:52.723496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:28:57.723816 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:28:57.723725 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:29:02.724068 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:02.724022 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:29:07.723612 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:07.723573 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:29:08.234155 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.234130 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:29:08.384977 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.384903 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") pod \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " Aug 05 17:29:08.384977 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.384967 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle\") pod \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\" (UID: \"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180\") " Aug 05 17:29:08.385296 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.385272 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" (UID: "0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:29:08.387037 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.387009 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" (UID: "0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:29:08.486041 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.486009 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-proxy-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:29:08.486041 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.486032 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180-openshift-service-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:29:08.864501 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.864461 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerID="1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b" exitCode=0 Aug 05 17:29:08.864904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.864512 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" Aug 05 17:29:08.864904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.864548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" event={"ID":"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180","Type":"ContainerDied","Data":"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b"} Aug 05 17:29:08.864904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.864608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn" event={"ID":"0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180","Type":"ContainerDied","Data":"e1f4b8d6ad1f40573cc141ad312a7046fa3c18ea2a990a8ad1c6bead67e3dc09"} Aug 05 17:29:08.864904 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.864630 2579 scope.go:117] "RemoveContainer" containerID="1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b" Aug 05 17:29:08.873517 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.873489 2579 scope.go:117] "RemoveContainer" containerID="1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b" Aug 05 17:29:08.873796 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:29:08.873776 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b\": container with ID starting with 1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b not found: ID does not exist" containerID="1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b" Aug 05 17:29:08.873889 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.873807 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b"} err="failed to get container status \"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b\": rpc error: code = NotFound desc = could not find container \"1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b\": container with ID starting with 1387342c76b196eaab1f1b559eb441a72b5b88f00b1b3352722c5f163ffd5a0b not found: ID does not exist" Aug 05 17:29:08.886662 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.886640 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:29:08.892757 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:08.892736 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-849e6-d59cdc6c5-mbfqn"] Aug 05 17:29:09.906188 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:29:09.906157 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" path="/var/lib/kubelet/pods/0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180/volumes" Aug 05 17:30:18.394809 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.394769 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:18.395368 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.395084 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" Aug 05 17:30:18.395368 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.395096 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" Aug 05 17:30:18.395368 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.395160 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0c3c8f-dc2f-4fb5-9d50-07e55ddfb180" containerName="model-chainer-raw-849e6" Aug 05 17:30:18.398077 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.398059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:18.401047 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.401022 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:30:18.401182 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.401150 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\"" Aug 05 17:30:18.405003 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.404979 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-f37da-serving-cert\"" Aug 05 17:30:18.405146 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.405038 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-f37da-kube-rbac-proxy-sar-config\"" Aug 05 17:30:18.451282 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.451257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:18.535995 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.535954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:18.535995 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.536003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:18.637352 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.637319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:18.637547 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.637357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:18.637547 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:30:18.637496 2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-serving-cert: secret "model-chainer-raw-hpa-f37da-serving-cert" not found Aug 05 17:30:18.637675 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:30:18.637553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls podName:e946e939-0858-4104-abb4-9336848ad29d nodeName:}" failed. No retries permitted until 2026-08-05 17:30:19.137536348 +0000 UTC m=+1067.800272986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls") pod "model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" (UID: "e946e939-0858-4104-abb4-9336848ad29d") : secret "model-chainer-raw-hpa-f37da-serving-cert" not found Aug 05 17:30:18.638031 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:18.638004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:19.141888 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:19.141859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:19.144248 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:19.144226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") pod \"model-chainer-raw-hpa-f37da-578c74c86d-5l9c2\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:19.310628 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:19.310587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:19.445479 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:19.445452 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:20.132086 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:20.132051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" event={"ID":"e946e939-0858-4104-abb4-9336848ad29d","Type":"ContainerStarted","Data":"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46"} Aug 05 17:30:20.132254 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:20.132104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" event={"ID":"e946e939-0858-4104-abb4-9336848ad29d","Type":"ContainerStarted","Data":"d2eb8beb7ca7a25da4a1eadff60ee128f62908f4d1ed162680d15d48d4a3242a"} Aug 05 17:30:20.132254 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:20.132206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:20.150340 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:20.150298 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podStartSLOduration=2.150286617 podStartE2EDuration="2.150286617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:20.148567633 +0000 UTC m=+1068.811304293" watchObservedRunningTime="2026-08-05 17:30:20.150286617 +0000 UTC m=+1068.813023276" Aug 05 17:30:26.144044 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:26.143960 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:28.395200 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:28.395163 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:28.395622 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:28.395365 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" containerID="cri-o://374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46" gracePeriod=30 Aug 05 17:30:31.142097 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:31.142053 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:36.142304 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:36.142257 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:41.141331 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:41.141286 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:41.141837 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:41.141389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:46.141564 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:46.141521 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:51.142018 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:51.141968 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:56.141384 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:56.141334 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:57.833143 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.833107 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c95fb8547-r6xqb"] Aug 05 17:30:57.836623 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.836595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.853114 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.853072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c95fb8547-r6xqb"] Aug 05 17:30:57.948222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-trusted-ca-bundle\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-oauth-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2w8\" (UniqueName: \"kubernetes.io/projected/b0b1aafe-045e-4257-997a-5bf96c2945ce-kube-api-access-gw2w8\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948463 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-service-ca\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:57.948772 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:57.948578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-oauth-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049651 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-oauth-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049651 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2w8\" (UniqueName: \"kubernetes.io/projected/b0b1aafe-045e-4257-997a-5bf96c2945ce-kube-api-access-gw2w8\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-service-ca\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-oauth-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-trusted-ca-bundle\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.049938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.049910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.050649 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.050620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-service-ca\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.050764 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.050620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-oauth-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.050764 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.050714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-trusted-ca-bundle\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.050850 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.050759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.052239 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.052207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-serving-cert\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.052340 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.052318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b1aafe-045e-4257-997a-5bf96c2945ce-console-oauth-config\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.059041 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.059022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2w8\" (UniqueName: \"kubernetes.io/projected/b0b1aafe-045e-4257-997a-5bf96c2945ce-kube-api-access-gw2w8\") pod \"console-7c95fb8547-r6xqb\" (UID: \"b0b1aafe-045e-4257-997a-5bf96c2945ce\") " pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.147067 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.146978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:30:58.286893 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.286867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c95fb8547-r6xqb"] Aug 05 17:30:58.289341 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:30:58.289312 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b1aafe_045e_4257_997a_5bf96c2945ce.slice/crio-d8120da4e65f94395d9a10ee7c883ddeecd9fcad48a2f6951e2da00a777555b4 WatchSource:0}: Error finding container d8120da4e65f94395d9a10ee7c883ddeecd9fcad48a2f6951e2da00a777555b4: Status 404 returned error can't find the container with id d8120da4e65f94395d9a10ee7c883ddeecd9fcad48a2f6951e2da00a777555b4 Aug 05 17:30:58.537491 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.537463 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:58.655222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.655130 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") pod \"e946e939-0858-4104-abb4-9336848ad29d\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " Aug 05 17:30:58.655222 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.655200 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle\") pod \"e946e939-0858-4104-abb4-9336848ad29d\" (UID: \"e946e939-0858-4104-abb4-9336848ad29d\") " Aug 05 17:30:58.655635 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.655601 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e946e939-0858-4104-abb4-9336848ad29d" (UID: "e946e939-0858-4104-abb4-9336848ad29d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:30:58.657223 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.657199 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e946e939-0858-4104-abb4-9336848ad29d" (UID: "e946e939-0858-4104-abb4-9336848ad29d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:30:58.756324 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.756285 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e946e939-0858-4104-abb4-9336848ad29d-openshift-service-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:30:58.756324 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:58.756315 2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e946e939-0858-4104-abb4-9336848ad29d-proxy-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:30:59.292177 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.292140 2579 generic.go:356] "Generic (PLEG): container finished" podID="e946e939-0858-4104-abb4-9336848ad29d" containerID="374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46" exitCode=0 Aug 05 17:30:59.292641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.292183 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" Aug 05 17:30:59.292641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.292230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" event={"ID":"e946e939-0858-4104-abb4-9336848ad29d","Type":"ContainerDied","Data":"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46"} Aug 05 17:30:59.292641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.292291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2" event={"ID":"e946e939-0858-4104-abb4-9336848ad29d","Type":"ContainerDied","Data":"d2eb8beb7ca7a25da4a1eadff60ee128f62908f4d1ed162680d15d48d4a3242a"} Aug 05 17:30:59.292641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.292320 2579 scope.go:117] "RemoveContainer" containerID="374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46" Aug 05 17:30:59.293999 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.293976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c95fb8547-r6xqb" event={"ID":"b0b1aafe-045e-4257-997a-5bf96c2945ce","Type":"ContainerStarted","Data":"17c35cc61658ef9668129f0a659aea98407033c99934702f38b0e2ccd1fd593d"} Aug 05 17:30:59.294112 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.294013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c95fb8547-r6xqb" event={"ID":"b0b1aafe-045e-4257-997a-5bf96c2945ce","Type":"ContainerStarted","Data":"d8120da4e65f94395d9a10ee7c883ddeecd9fcad48a2f6951e2da00a777555b4"} Aug 05 17:30:59.301897 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.301878 2579 scope.go:117] "RemoveContainer" containerID="374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46" Aug 05 17:30:59.302170 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:30:59.302152 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46\": container with ID starting with 374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46 not found: ID does not exist" containerID="374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46" Aug 05 17:30:59.302237 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.302177 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46"} err="failed to get container status \"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46\": rpc error: code = NotFound desc = could not find container \"374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46\": container with ID starting with 374e8afec358f5704ccc22195a57cc82371ca34bbe7fd28dda3796065d66cb46 not found: ID does not exist" Aug 05 17:30:59.316872 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.316787 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c95fb8547-r6xqb" podStartSLOduration=2.316772313 podStartE2EDuration="2.316772313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:59.314691488 +0000 UTC m=+1107.977428175" watchObservedRunningTime="2026-08-05 17:30:59.316772313 +0000 UTC m=+1107.979508973" Aug 05 17:30:59.328117 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.328091 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:59.332335 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.332304 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-f37da-578c74c86d-5l9c2"] Aug 05 17:30:59.907736 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:30:59.907701 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e946e939-0858-4104-abb4-9336848ad29d" path="/var/lib/kubelet/pods/e946e939-0858-4104-abb4-9336848ad29d/volumes" Aug 05 17:31:08.147303 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:08.147250 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:31:08.147303 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:08.147324 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:31:08.152016 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:08.151994 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:31:08.339276 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:08.339245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c95fb8547-r6xqb" Aug 05 17:31:08.400615 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:08.400543 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:31:33.428691 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.428642 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d5d6c7ddd-7jr56" podUID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" containerName="console" containerID="cri-o://609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26" gracePeriod=15 Aug 05 17:31:33.671810 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.671785 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:31:33.761773 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761693 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.761773 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761725 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.761773 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761741 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.761773 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761762 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.762075 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761786 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.762075 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761813 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dclkn\" (UniqueName: \"kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.762075 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.761838 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert\") pod \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\" (UID: \"fad7b552-e221-47b1-8fae-fcb30abb5f5a\") " Aug 05 17:31:33.762228 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.762159 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:31:33.762488 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.762395 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:31:33.762617 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.762521 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config" (OuterVolumeSpecName: "console-config") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:31:33.762617 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.762516 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:31:33.763992 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.763967 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn" (OuterVolumeSpecName: "kube-api-access-dclkn") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "kube-api-access-dclkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:33.764087 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.763996 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:31:33.764087 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.764013 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fad7b552-e221-47b1-8fae-fcb30abb5f5a" (UID: "fad7b552-e221-47b1-8fae-fcb30abb5f5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:31:33.862606 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862569 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862606 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862597 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862606 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862610 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-service-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862834 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862620 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fad7b552-e221-47b1-8fae-fcb30abb5f5a-console-oauth-config\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862834 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862633 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-trusted-ca-bundle\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862834 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862645 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dclkn\" (UniqueName: \"kubernetes.io/projected/fad7b552-e221-47b1-8fae-fcb30abb5f5a-kube-api-access-dclkn\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:33.862834 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:33.862659 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fad7b552-e221-47b1-8fae-fcb30abb5f5a-oauth-serving-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:31:34.439958 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.439922 2579 generic.go:356] "Generic (PLEG): container finished" podID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" containerID="609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26" exitCode=0 Aug 05 17:31:34.440443 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.439967 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d6c7ddd-7jr56" Aug 05 17:31:34.440443 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.440008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d6c7ddd-7jr56" event={"ID":"fad7b552-e221-47b1-8fae-fcb30abb5f5a","Type":"ContainerDied","Data":"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26"} Aug 05 17:31:34.440443 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.440071 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d6c7ddd-7jr56" event={"ID":"fad7b552-e221-47b1-8fae-fcb30abb5f5a","Type":"ContainerDied","Data":"735eb7f18e02fd66f6f5869ba4ee09de0fe2d98cba367b83f9354dd70c8a04ff"} Aug 05 17:31:34.440443 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.440104 2579 scope.go:117] "RemoveContainer" containerID="609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26" Aug 05 17:31:34.448661 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.448640 2579 scope.go:117] "RemoveContainer" containerID="609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26" Aug 05 17:31:34.448929 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:31:34.448910 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26\": container with ID starting with 609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26 not found: ID does not exist" containerID="609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26" Aug 05 17:31:34.448991 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.448938 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26"} err="failed to get container status \"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26\": rpc error: code = NotFound desc = could not find container \"609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26\": container with ID starting with 609744efd02e69153f69fd7498d01705bb4b4c894d7e36a68217050de1af0b26 not found: ID does not exist" Aug 05 17:31:34.462588 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.462564 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:31:34.473997 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:34.473973 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d5d6c7ddd-7jr56"] Aug 05 17:31:35.907103 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:31:35.907070 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" path="/var/lib/kubelet/pods/fad7b552-e221-47b1-8fae-fcb30abb5f5a/volumes" Aug 05 17:32:31.826903 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:32:31.826871 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:32:31.829542 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:32:31.829519 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:37:31.856782 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:37:31.856753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:37:31.860071 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:37:31.860051 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:41:55.925227 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925191 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jt96s/must-gather-vflx9"] Aug 05 17:41:55.925837 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925725 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" containerName="console" Aug 05 17:41:55.925837 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925746 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" containerName="console" Aug 05 17:41:55.925837 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925762 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" Aug 05 17:41:55.925837 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925771 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" Aug 05 17:41:55.926058 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925852 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e946e939-0858-4104-abb4-9336848ad29d" containerName="model-chainer-raw-hpa-f37da" Aug 05 17:41:55.926058 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.925863 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad7b552-e221-47b1-8fae-fcb30abb5f5a" containerName="console" Aug 05 17:41:55.928968 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.928947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:55.932643 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.932623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jt96s\"/\"default-dockercfg-qkpsp\"" Aug 05 17:41:55.933466 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.933436 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jt96s\"/\"openshift-service-ca.crt\"" Aug 05 17:41:55.933569 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.933507 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jt96s\"/\"kube-root-ca.crt\"" Aug 05 17:41:55.937717 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.937691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jt96s/must-gather-vflx9"] Aug 05 17:41:55.984585 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.984557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvwdl\" (UniqueName: \"kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:55.984705 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:55.984649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.085520 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.085425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.085662 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.085583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvwdl\" (UniqueName: \"kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.085711 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.085688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.097762 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.097740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvwdl\" (UniqueName: \"kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl\") pod \"must-gather-vflx9\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.257439 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.257339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:41:56.387038 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.387009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jt96s/must-gather-vflx9"] Aug 05 17:41:56.389524 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:41:56.389489 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf6e2afa_5e44_454c_91f4_44ad33704375.slice/crio-a8a7cbcf59987b025e076493ec6ae94d88eb7ad2aff138d03a8a36ca79e2dd2a WatchSource:0}: Error finding container a8a7cbcf59987b025e076493ec6ae94d88eb7ad2aff138d03a8a36ca79e2dd2a: Status 404 returned error can't find the container with id a8a7cbcf59987b025e076493ec6ae94d88eb7ad2aff138d03a8a36ca79e2dd2a Aug 05 17:41:56.391561 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.391547 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:41:56.906270 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:41:56.906233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jt96s/must-gather-vflx9" event={"ID":"cf6e2afa-5e44-454c-91f4-44ad33704375","Type":"ContainerStarted","Data":"a8a7cbcf59987b025e076493ec6ae94d88eb7ad2aff138d03a8a36ca79e2dd2a"} Aug 05 17:42:02.936098 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:02.936014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jt96s/must-gather-vflx9" event={"ID":"cf6e2afa-5e44-454c-91f4-44ad33704375","Type":"ContainerStarted","Data":"eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196"} Aug 05 17:42:02.936098 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:02.936055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jt96s/must-gather-vflx9" event={"ID":"cf6e2afa-5e44-454c-91f4-44ad33704375","Type":"ContainerStarted","Data":"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814"} Aug 05 17:42:02.956509 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:02.956454 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jt96s/must-gather-vflx9" podStartSLOduration=1.827095011 podStartE2EDuration="7.956439327s" totalImagesPullingTime="6.129344316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:02.95394401 +0000 UTC m=+1771.616680689" watchObservedRunningTime="2026-08-05 17:42:02.956439327 +0000 UTC m=+1771.619175986" Aug 05 17:42:26.038533 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:26.038498 2579 generic.go:356] "Generic (PLEG): container finished" podID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerID="9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814" exitCode=0 Aug 05 17:42:26.039043 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:26.038572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jt96s/must-gather-vflx9" event={"ID":"cf6e2afa-5e44-454c-91f4-44ad33704375","Type":"ContainerDied","Data":"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814"} Aug 05 17:42:26.039043 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:26.038920 2579 scope.go:117] "RemoveContainer" containerID="9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814" Aug 05 17:42:26.754980 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:26.754943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jt96s_must-gather-vflx9_cf6e2afa-5e44-454c-91f4-44ad33704375/gather/0.log" Aug 05 17:42:30.294873 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:30.294845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zxv4c_8721ab10-ae72-4e9b-bf8d-98adbe647c61/global-pull-secret-syncer/0.log" Aug 05 17:42:30.411951 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:30.411922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-np6sw_ee13a0c5-539c-4c8b-a8c6-8fc408e85e66/konnectivity-agent/0.log" Aug 05 17:42:30.528641 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:30.528612 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-107.ec2.internal_a04f0d69322552c16be42899defc244b/haproxy/0.log" Aug 05 17:42:31.883712 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:31.883682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:42:31.886560 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:31.886535 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:42:32.200567 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.200489 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jt96s/must-gather-vflx9"] Aug 05 17:42:32.200723 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.200664 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-jt96s/must-gather-vflx9" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="copy" containerID="cri-o://eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196" gracePeriod=2 Aug 05 17:42:32.214788 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.214763 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jt96s/must-gather-vflx9"] Aug 05 17:42:32.437435 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.437402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jt96s_must-gather-vflx9_cf6e2afa-5e44-454c-91f4-44ad33704375/copy/0.log" Aug 05 17:42:32.438987 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.438962 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:42:32.441218 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:42:32.441197 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vflx9\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jt96s\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:42:32.606002 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.605968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvwdl\" (UniqueName: \"kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl\") pod \"cf6e2afa-5e44-454c-91f4-44ad33704375\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " Aug 05 17:42:32.606171 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.606049 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output\") pod \"cf6e2afa-5e44-454c-91f4-44ad33704375\" (UID: \"cf6e2afa-5e44-454c-91f4-44ad33704375\") " Aug 05 17:42:32.608038 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.608015 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cf6e2afa-5e44-454c-91f4-44ad33704375" (UID: "cf6e2afa-5e44-454c-91f4-44ad33704375"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:42:32.608230 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.608209 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl" (OuterVolumeSpecName: "kube-api-access-kvwdl") pod "cf6e2afa-5e44-454c-91f4-44ad33704375" (UID: "cf6e2afa-5e44-454c-91f4-44ad33704375"). InnerVolumeSpecName "kube-api-access-kvwdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:42:32.707633 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.707607 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf6e2afa-5e44-454c-91f4-44ad33704375-must-gather-output\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:42:32.707633 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:32.707632 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvwdl\" (UniqueName: \"kubernetes.io/projected/cf6e2afa-5e44-454c-91f4-44ad33704375-kube-api-access-kvwdl\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Aug 05 17:42:33.068059 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.068033 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jt96s_must-gather-vflx9_cf6e2afa-5e44-454c-91f4-44ad33704375/copy/0.log" Aug 05 17:42:33.068471 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.068360 2579 generic.go:356] "Generic (PLEG): container finished" podID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerID="eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196" exitCode=143 Aug 05 17:42:33.068471 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.068427 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:42:33.068471 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.068446 2579 scope.go:117] "RemoveContainer" containerID="eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196" Aug 05 17:42:33.072650 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:42:33.072613 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vflx9\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jt96s\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:42:33.076257 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.076232 2579 scope.go:117] "RemoveContainer" containerID="9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814" Aug 05 17:42:33.081593 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:42:33.081567 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vflx9\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jt96s\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" pod="openshift-must-gather-jt96s/must-gather-vflx9" Aug 05 17:42:33.087179 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.087158 2579 scope.go:117] "RemoveContainer" containerID="eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196" Aug 05 17:42:33.087435 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:42:33.087397 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196\": container with ID starting with eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196 not found: ID does not exist" containerID="eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196" Aug 05 17:42:33.087498 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.087444 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196"} err="failed to get container status \"eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196\": rpc error: code = NotFound desc = could not find container \"eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196\": container with ID starting with eb00130fbb218e8b0f2ec00ecb7077a7568aba21b7ae7bf743b13e46e42c8196 not found: ID does not exist" Aug 05 17:42:33.087498 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.087460 2579 scope.go:117] "RemoveContainer" containerID="9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814" Aug 05 17:42:33.087697 ip-10-0-136-107 kubenswrapper[2579]: E0805 17:42:33.087679 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814\": container with ID starting with 9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814 not found: ID does not exist" containerID="9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814" Aug 05 17:42:33.087733 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.087703 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814"} err="failed to get container status \"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814\": rpc error: code = NotFound desc = could not find container \"9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814\": container with ID starting with 9bf6b344ded3b60fe9502b28f47cbc60cd9f97777c5dbfe942a18305c3fa6814 not found: ID does not exist" Aug 05 17:42:33.906308 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:33.906274 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" path="/var/lib/kubelet/pods/cf6e2afa-5e44-454c-91f4-44ad33704375/volumes" Aug 05 17:42:34.366176 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.366149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/alertmanager/0.log" Aug 05 17:42:34.400794 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.400772 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/config-reloader/0.log" Aug 05 17:42:34.436480 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.436454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/kube-rbac-proxy-web/0.log" Aug 05 17:42:34.472691 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.472659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/kube-rbac-proxy/0.log" Aug 05 17:42:34.534908 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.534841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/kube-rbac-proxy-metric/0.log" Aug 05 17:42:34.598582 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.598560 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/prom-label-proxy/0.log" Aug 05 17:42:34.631938 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.631912 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2571aaf6-d4ce-41ef-8b6d-794c2a8c53c3/init-config-reloader/0.log" Aug 05 17:42:34.866901 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:34.866831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-8zrfk_93e85987-b9b1-4f30-8dbb-9fce5e730385/monitoring-plugin/0.log" Aug 05 17:42:35.115847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.115820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slvjn_2c6ff2ea-1229-4cc9-8358-53040590d877/node-exporter/0.log" Aug 05 17:42:35.144132 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.144077 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slvjn_2c6ff2ea-1229-4cc9-8358-53040590d877/kube-rbac-proxy/0.log" Aug 05 17:42:35.176822 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.176801 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slvjn_2c6ff2ea-1229-4cc9-8358-53040590d877/init-textfile/0.log" Aug 05 17:42:35.354614 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.354586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/prometheus/0.log" Aug 05 17:42:35.381891 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.381865 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/config-reloader/0.log" Aug 05 17:42:35.412666 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.412599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/thanos-sidecar/0.log" Aug 05 17:42:35.448986 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.448968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/kube-rbac-proxy-web/0.log" Aug 05 17:42:35.484112 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.484095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/kube-rbac-proxy/0.log" Aug 05 17:42:35.511401 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.511380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/kube-rbac-proxy-thanos/0.log" Aug 05 17:42:35.545214 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.545195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb115ac-b60b-4a10-8f2b-29e64ea8046a/init-config-reloader/0.log" Aug 05 17:42:35.584949 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.584926 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4wz45_3d8baa3f-f918-4a48-b177-61bb20c4e8c2/prometheus-operator/0.log" Aug 05 17:42:35.614112 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.614088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4wz45_3d8baa3f-f918-4a48-b177-61bb20c4e8c2/kube-rbac-proxy/0.log" Aug 05 17:42:35.705024 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.704958 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f68859756-gvfbb_2a59ecea-426a-452d-8451-95c9d91b6d97/telemeter-client/0.log" Aug 05 17:42:35.742754 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.742728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f68859756-gvfbb_2a59ecea-426a-452d-8451-95c9d91b6d97/reload/0.log" Aug 05 17:42:35.789910 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:35.789888 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f68859756-gvfbb_2a59ecea-426a-452d-8451-95c9d91b6d97/kube-rbac-proxy/0.log" Aug 05 17:42:37.199482 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:37.199453 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-dtpmr_45d3e15c-4245-47d9-9f92-b72e347a3dbc/networking-console-plugin/0.log" Aug 05 17:42:38.005521 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005484 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh"] Aug 05 17:42:38.005816 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005805 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="copy" Aug 05 17:42:38.005860 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005818 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="copy" Aug 05 17:42:38.005860 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005828 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="gather" Aug 05 17:42:38.005860 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005834 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="gather" Aug 05 17:42:38.005953 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005887 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="copy" Aug 05 17:42:38.005953 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.005896 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6e2afa-5e44-454c-91f4-44ad33704375" containerName="gather" Aug 05 17:42:38.007864 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.007847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.010379 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.010361 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjq9m\"/\"openshift-service-ca.crt\"" Aug 05 17:42:38.010508 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.010435 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjq9m\"/\"kube-root-ca.crt\"" Aug 05 17:42:38.011240 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.011221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jjq9m\"/\"default-dockercfg-fndrf\"" Aug 05 17:42:38.018404 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.018378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh"] Aug 05 17:42:38.158733 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.158694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-podres\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.158733 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.158737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwp6\" (UniqueName: \"kubernetes.io/projected/047b98f7-56b7-4805-b5c1-f81955d82cae-kube-api-access-wfwp6\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.158933 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.158840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-sys\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.158933 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.158897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-lib-modules\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.158933 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.158932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-proc\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.250342 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.250312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c95fb8547-r6xqb_b0b1aafe-045e-4257-997a-5bf96c2945ce/console/0.log" Aug 05 17:42:38.259593 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-sys\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-lib-modules\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-proc\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-podres\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-sys\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259677 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwp6\" (UniqueName: \"kubernetes.io/projected/047b98f7-56b7-4805-b5c1-f81955d82cae-kube-api-access-wfwp6\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-proc\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-podres\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.259847 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.259793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/047b98f7-56b7-4805-b5c1-f81955d82cae-lib-modules\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.268719 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.268699 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwp6\" (UniqueName: \"kubernetes.io/projected/047b98f7-56b7-4805-b5c1-f81955d82cae-kube-api-access-wfwp6\") pod \"perf-node-gather-daemonset-695jh\" (UID: \"047b98f7-56b7-4805-b5c1-f81955d82cae\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.288799 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.288777 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-bwk2x_da66b9dc-07db-4263-8d4d-5c1c5e15d943/download-server/0.log" Aug 05 17:42:38.318030 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.318014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:38.451999 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:38.451974 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh"] Aug 05 17:42:38.454744 ip-10-0-136-107 kubenswrapper[2579]: W0805 17:42:38.454708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod047b98f7_56b7_4805_b5c1_f81955d82cae.slice/crio-559af8a0d6202e359d37217b9e816d63756efb580e6640c768719a962f5d8aec WatchSource:0}: Error finding container 559af8a0d6202e359d37217b9e816d63756efb580e6640c768719a962f5d8aec: Status 404 returned error can't find the container with id 559af8a0d6202e359d37217b9e816d63756efb580e6640c768719a962f5d8aec Aug 05 17:42:39.093288 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:39.093250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" event={"ID":"047b98f7-56b7-4805-b5c1-f81955d82cae","Type":"ContainerStarted","Data":"3d7cba93e7f5ea9ed9444a5b23509be53c5598e5a510d74a3e40b800e1622c28"} Aug 05 17:42:39.093752 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:39.093336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" event={"ID":"047b98f7-56b7-4805-b5c1-f81955d82cae","Type":"ContainerStarted","Data":"559af8a0d6202e359d37217b9e816d63756efb580e6640c768719a962f5d8aec"} Aug 05 17:42:39.093752 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:39.093366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:39.113832 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:39.113774 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" podStartSLOduration=2.113755941 podStartE2EDuration="2.113755941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:39.112183664 +0000 UTC m=+1807.774920323" watchObservedRunningTime="2026-08-05 17:42:39.113755941 +0000 UTC m=+1807.776492604" Aug 05 17:42:40.136701 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:40.136678 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pbvdz_fd1077d4-d334-4841-8320-79b660e24365/dns/0.log" Aug 05 17:42:40.168768 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:40.168741 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pbvdz_fd1077d4-d334-4841-8320-79b660e24365/kube-rbac-proxy/0.log" Aug 05 17:42:40.274399 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:40.274363 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t29x8_1a605a4f-fdab-496a-a599-e49eed4f3a1c/dns-node-resolver/0.log" Aug 05 17:42:40.836184 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:40.836152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49sdz_52e85a9e-ea75-424e-89c3-9a7853635c86/node-ca/0.log" Aug 05 17:42:41.748072 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:41.748041 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754fbb68d6-44946_2a67ec08-1897-4fbb-8317-170799f1c48b/router/0.log" Aug 05 17:42:42.194552 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.194525 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghsgr_da4a119f-cdbd-4d92-801b-dcaec9911afd/serve-healthcheck-canary/0.log" Aug 05 17:42:42.640079 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.640049 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-d2b2t_2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc/insights-operator/0.log" Aug 05 17:42:42.640282 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.640267 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-d2b2t_2a44eec4-a364-4121-9c9e-2ea7e6aaf4bc/insights-operator/1.log" Aug 05 17:42:42.672956 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.672936 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lzdx_1fbf86b9-6363-4faa-a833-4571b694bd2c/kube-rbac-proxy/0.log" Aug 05 17:42:42.706291 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.706266 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lzdx_1fbf86b9-6363-4faa-a833-4571b694bd2c/exporter/0.log" Aug 05 17:42:42.734603 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:42.734557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lzdx_1fbf86b9-6363-4faa-a833-4571b694bd2c/extractor/0.log" Aug 05 17:42:45.106103 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:45.106069 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-695jh" Aug 05 17:42:51.791796 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.791763 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/kube-multus-additional-cni-plugins/0.log" Aug 05 17:42:51.818725 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.818703 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/egress-router-binary-copy/0.log" Aug 05 17:42:51.849541 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.849511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/cni-plugins/0.log" Aug 05 17:42:51.877082 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.877061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/bond-cni-plugin/0.log" Aug 05 17:42:51.930097 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.930073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/routeoverride-cni/0.log" Aug 05 17:42:51.980753 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:51.980729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/whereabouts-cni-bincopy/0.log" Aug 05 17:42:52.018554 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:52.018529 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4tlz_1e92259e-3325-4cd9-a758-35dc8276f036/whereabouts-cni/0.log" Aug 05 17:42:52.493826 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:52.493793 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hhkcx_119bbf88-fdb1-4fca-ade3-77a093f94d26/kube-multus/0.log" Aug 05 17:42:52.605580 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:52.605549 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rpbtn_a4d15ffe-a70c-4251-9109-15471c53c56f/network-metrics-daemon/0.log" Aug 05 17:42:52.639160 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:52.639134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rpbtn_a4d15ffe-a70c-4251-9109-15471c53c56f/kube-rbac-proxy/0.log" Aug 05 17:42:53.740433 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.740394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-controller/0.log" Aug 05 17:42:53.765767 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.765740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/0.log" Aug 05 17:42:53.765908 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.765842 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovn-acl-logging/1.log" Aug 05 17:42:53.788862 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.788840 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/kube-rbac-proxy-node/0.log" Aug 05 17:42:53.813277 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.813258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/kube-rbac-proxy-ovn-metrics/0.log" Aug 05 17:42:53.837877 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.837858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/northd/0.log" Aug 05 17:42:53.862760 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.862740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/nbdb/0.log" Aug 05 17:42:53.893546 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.893519 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/sbdb/0.log" Aug 05 17:42:53.936329 ip-10-0-136-107 kubenswrapper[2579]: I0805 17:42:53.936308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x55zr_ebed45c0-9d7b-4e1c-a3fb-44f6e43ed145/ovnkube-controller/0.log"