Jul 15 22:33:26.794218 ip-10-0-139-147 systemd[1]: Starting Kubernetes Kubelet... Jul 15 22:33:27.186398 ip-10-0-139-147 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:27.186398 ip-10-0-139-147 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 22:33:27.186398 ip-10-0-139-147 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:27.187135 ip-10-0-139-147 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 22:33:27.187135 ip-10-0-139-147 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:33:27.187820 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.187589 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 22:33:27.191931 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191893 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191933 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191939 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191942 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191944 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191948 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191951 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191953 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191956 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191959 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191962 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191965 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191968 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191971 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191973 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191976 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.191974 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191979 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191988 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191991 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191994 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.191997 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192000 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192002 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192005 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192007 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192010 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192012 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192015 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192017 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192019 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192022 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192024 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192027 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192029 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192032 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192034 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.192355 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192037 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192039 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192042 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192044 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192047 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192049 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192051 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192054 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192056 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192058 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192063 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192067 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192069 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192072 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192075 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192078 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192081 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192083 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192086 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.192838 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192088 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192091 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192095 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192099 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192103 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192105 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192108 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192111 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192114 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192116 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192119 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192122 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192124 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192127 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192129 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192131 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192134 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192137 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192139 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192142 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.193318 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192145 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192147 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192149 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192152 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192154 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192157 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192160 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192165 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192168 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192171 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192173 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192176 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192178 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192181 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192185 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192188 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192191 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192194 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192197 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192200 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.193799 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192202 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192205 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192208 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192211 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192949 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192956 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192959 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192962 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192964 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192967 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192970 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192973 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192976 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192979 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192981 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192984 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192986 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192989 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192993 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.192997 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.194302 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193000 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193003 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193005 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193008 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193010 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193013 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193015 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193018 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193021 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193023 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193026 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193028 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193031 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193033 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193036 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193038 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193041 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193044 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193046 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193049 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.194910 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193051 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193054 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193056 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193060 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193063 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193067 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193071 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193074 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193077 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193079 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193082 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193086 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193088 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193092 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193096 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193098 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193101 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193105 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.195405 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193108 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193111 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193113 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193116 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193119 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193121 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193124 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193126 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193129 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193131 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193134 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193136 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193139 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193141 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193144 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193146 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193149 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193152 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193154 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193156 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.195844 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193159 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193161 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193164 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193167 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193170 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193172 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193177 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193181 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193183 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193186 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193189 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193191 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193193 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193195 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193198 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193200 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193203 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193205 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193208 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193210 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.196342 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193213 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193215 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193217 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193220 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193222 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193617 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193622 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193625 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193628 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193630 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193633 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193635 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193638 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193641 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193644 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193647 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193649 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193653 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193656 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193659 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.196868 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193661 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193664 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193666 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193669 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193673 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193677 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193680 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193682 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193685 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193688 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193690 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193693 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193695 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193698 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193700 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193703 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193705 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193708 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193710 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.197370 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193712 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193715 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193720 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193722 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193725 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193727 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193730 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193733 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193736 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193738 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193741 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193744 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193749 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193753 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193756 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193759 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193761 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193764 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193766 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.197833 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193769 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193771 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193774 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193777 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193781 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193784 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193786 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193789 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193791 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193794 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193798 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193801 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193803 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193806 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193809 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193812 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193815 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193818 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193820 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193823 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.198331 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193825 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193828 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193830 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193832 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193835 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193837 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193840 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193843 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193845 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193848 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193850 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193852 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193855 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193857 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193860 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193862 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193864 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193867 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193869 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193871 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.198808 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193874 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193876 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193879 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193881 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193885 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.193888 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.193977 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.193999 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194011 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194016 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194020 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194023 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194027 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194031 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194034 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194038 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194041 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194044 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194047 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194051 2556 flags.go:64] FLAG: --cgroup-root="" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194054 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194057 2556 flags.go:64] FLAG: --client-ca-file="" Jul 15 22:33:27.199292 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194062 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194065 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194070 2556 flags.go:64] FLAG: --cluster-domain="" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194072 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194076 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194079 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194083 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194087 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194090 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194093 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194096 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194099 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194102 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194105 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194108 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194111 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194115 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194118 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194122 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194124 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194127 2556 flags.go:64] FLAG: --enable-server="true" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194130 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194135 2556 flags.go:64] FLAG: --event-burst="100" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194138 2556 flags.go:64] FLAG: --event-qps="50" Jul 15 22:33:27.199856 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194141 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194144 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194147 2556 flags.go:64] FLAG: --eviction-hard="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194151 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194153 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194156 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194160 2556 flags.go:64] FLAG: --eviction-soft="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194163 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194167 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194170 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194173 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194176 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194179 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194182 2556 flags.go:64] FLAG: --feature-gates="" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194186 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194188 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194191 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194194 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194198 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194200 2556 flags.go:64] FLAG: --help="false" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194203 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194206 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194210 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 22:33:27.200443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194213 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194216 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194219 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194222 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194225 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194228 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194231 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194234 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194237 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194240 2556 flags.go:64] FLAG: --kube-reserved="" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194242 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194245 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194248 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194251 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194254 2556 flags.go:64] FLAG: --lock-file="" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194256 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194260 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194264 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194269 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194272 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194275 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194277 2556 flags.go:64] FLAG: --logging-format="text" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194280 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194283 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 22:33:27.201121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194286 2556 flags.go:64] FLAG: --manifest-url="" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194288 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194293 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194296 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194299 2556 flags.go:64] FLAG: --max-pods="110" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194302 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194305 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194308 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194312 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194315 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194320 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194323 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194331 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194334 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194337 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194340 2556 flags.go:64] FLAG: --pod-cidr="" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194343 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194349 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194352 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194355 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194359 2556 flags.go:64] FLAG: --port="10250" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194362 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194364 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-053ba60718979e332" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194367 2556 flags.go:64] FLAG: --qos-reserved="" Jul 15 22:33:27.202055 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194370 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194375 2556 flags.go:64] FLAG: --register-node="true" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194378 2556 flags.go:64] FLAG: --register-with-taints="" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194381 2556 flags.go:64] FLAG: --registry-burst="10" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194385 2556 flags.go:64] FLAG: --registry-qps="5" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194388 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194390 2556 flags.go:64] FLAG: --reserved-memory="" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194394 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194397 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194400 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194403 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194406 2556 flags.go:64] FLAG: --runonce="false" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194409 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194412 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194415 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194417 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194420 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194423 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194426 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194430 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194433 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194436 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194439 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194442 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194445 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 22:33:27.203087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194448 2556 flags.go:64] FLAG: --system-cgroups="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194450 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194456 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194459 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194461 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194466 2556 flags.go:64] FLAG: --tls-min-version="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194469 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194471 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194476 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194479 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194482 2556 flags.go:64] FLAG: --v="2" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194487 2556 flags.go:64] FLAG: --version="false" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194491 2556 flags.go:64] FLAG: --vmodule="" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194494 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.194497 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194613 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194617 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194620 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194623 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194626 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194629 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194631 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194634 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.204010 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194637 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194639 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194642 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194647 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194650 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194652 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194655 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194658 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194660 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194663 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194665 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194668 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194670 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194674 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194677 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194680 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194683 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194687 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194690 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194696 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.204636 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194699 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194702 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194704 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194707 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194710 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194713 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194715 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194718 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194720 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194723 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194725 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194728 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194731 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194733 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194735 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194739 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194742 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194744 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194747 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.205527 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194751 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194755 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194758 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194761 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194763 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194766 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194768 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194771 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194773 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194776 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194779 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194782 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194785 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194788 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194791 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194793 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194796 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194798 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194801 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194803 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.206390 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194806 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194808 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194812 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194815 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194818 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194821 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194824 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194827 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194831 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194834 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194836 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194839 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194842 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194845 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194848 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194850 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194852 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194855 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194857 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.207136 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194860 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194862 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194865 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194869 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194871 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194874 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194876 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194879 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194882 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194884 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194886 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194889 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.194892 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.195719 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.203708 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 22:33:27.207935 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.203729 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.204583 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.204602 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204708 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204719 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204724 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204729 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204734 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204739 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204744 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204748 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204752 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204756 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204760 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204765 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204769 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204773 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204777 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204781 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204785 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.208384 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204790 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204794 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204798 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204802 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204806 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204810 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204815 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204819 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204823 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204827 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204831 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204835 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204841 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204846 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204850 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204854 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204858 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204863 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204868 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204871 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.209030 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204876 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204880 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204884 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204888 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204892 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204912 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204917 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204921 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204925 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204929 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204934 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204938 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204943 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204946 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204950 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204954 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204958 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204963 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204967 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204972 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.209599 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204976 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204980 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204985 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204988 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204994 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.204999 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205004 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205008 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205015 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205021 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205025 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205030 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205035 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205040 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205045 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205049 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205053 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205057 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205063 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.210176 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205069 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205075 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205080 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205084 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205088 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205093 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205097 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205103 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205109 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205113 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205117 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205122 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205127 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205131 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205135 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205140 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205145 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205151 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205156 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.210692 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205161 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205165 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205170 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205175 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.205183 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205376 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205385 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205390 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205394 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205399 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205404 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205408 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205412 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205416 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205420 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:33:27.211209 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205424 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205432 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205438 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205443 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205447 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205452 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205456 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205460 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205464 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205468 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205473 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205477 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205481 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205485 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205489 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205494 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205499 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205503 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:33:27.211586 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205510 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205514 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205519 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205523 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205527 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205530 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205534 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205538 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205541 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205545 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205550 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205554 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205558 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205562 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205567 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205572 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205576 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205580 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205584 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205588 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:33:27.212058 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205592 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205596 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205601 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205605 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205610 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205614 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205618 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205622 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205627 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205631 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205636 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205640 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205645 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205650 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205654 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205658 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205662 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205666 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205670 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205675 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205679 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:33:27.212576 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205683 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205686 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205691 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205695 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205699 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205703 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205707 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205712 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205717 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205721 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205725 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205729 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205735 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205741 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205746 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205751 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205755 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205759 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205764 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:33:27.213434 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205768 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205772 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205777 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205781 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205785 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205789 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205794 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205798 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205803 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205807 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:27.205811 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.205819 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.206013 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.208707 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 22:33:27.214242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.210371 2556 server.go:1019] "Starting client certificate rotation" Jul 15 22:33:27.214815 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.210476 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:33:27.214815 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.210516 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:33:27.214815 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.213149 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:33:27.215000 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.214985 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:33:27.225451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.225431 2556 log.go:25] "Validated CRI v1 runtime API" Jul 15 22:33:27.228863 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.228845 2556 log.go:25] "Validated CRI v1 image API" Jul 15 22:33:27.229614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.229593 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 22:33:27.231999 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.231978 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a84b8a2d-6110-4bb6-8af5-ac3e7c0be49e:/dev/nvme0n1p3 f2ecca22-3cfd-47cb-adbc-0b9b89a20f23:/dev/nvme0n1p4] Jul 15 22:33:27.232070 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.231999 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 22:33:27.237062 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.236930 2556 manager.go:216] Machine: {Timestamp:2026-07-15 22:33:27.235621438 +0000 UTC m=+0.326272672 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100807 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d4798e96af74c08f588abb1b04a1 SystemUUID:ec29d479-8e96-af74-c08f-588abb1b04a1 BootID:94dcbcf7-c5f6-4731-b045-fc2e7fc57298 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:35:d9:d0:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:35:d9:d0:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:21:25:57:66:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 22:33:27.237062 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.237052 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 22:33:27.237216 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.237143 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 22:33:27.239264 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.239244 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:33:27.239840 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.239810 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 22:33:27.240006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.239845 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 22:33:27.240580 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.240569 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 22:33:27.240614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.240583 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 22:33:27.240614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.240591 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:33:27.242411 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.242400 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:33:27.243210 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.243200 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 22:33:27.245683 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245670 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:33:27.245806 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245797 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 22:33:27.245840 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245827 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 15 22:33:27.245870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245844 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 22:33:27.245870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245863 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 22:33:27.245949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245872 2556 kubelet.go:398] "Adding apiserver pod source" Jul 15 22:33:27.245949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.245882 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 22:33:27.246283 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.246271 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:33:27.246334 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.246290 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:33:27.248517 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.248501 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 22:33:27.249675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.249661 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 22:33:27.249717 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.249692 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 22:33:27.250271 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250258 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 22:33:27.250305 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250278 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 22:33:27.250305 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250284 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 22:33:27.250305 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250290 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 22:33:27.250305 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250300 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250306 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250390 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250396 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250402 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250407 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250421 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 22:33:27.250455 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.250429 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 22:33:27.251134 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.251124 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 22:33:27.251134 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.251134 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 22:33:27.254605 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.254588 2556 server.go:1268] "Started kubelet" Jul 15 22:33:27.255133 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.254965 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 22:33:27.255224 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.254890 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 22:33:27.255343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.255326 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 22:33:27.255766 ip-10-0-139-147 systemd[1]: Started Kubernetes Kubelet. Jul 15 22:33:27.256763 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.256731 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 22:33:27.257416 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.257399 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 15 22:33:27.257721 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.257695 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 22:33:27.258180 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.258128 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 22:33:27.258180 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.258128 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 22:33:27.260891 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.260872 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 22:33:27.260993 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.260879 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 22:33:27.261043 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.261019 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.262482 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.262444 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 22:33:27.262482 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.262485 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 22:33:27.262804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.262786 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 15 22:33:27.262804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.262799 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 15 22:33:27.263093 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.263071 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 22:33:27.263543 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.263525 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 22:33:27.264409 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.264391 2556 factory.go:55] Registering systemd factory Jul 15 22:33:27.264409 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.264412 2556 factory.go:223] Registration of the systemd container factory successfully Jul 15 22:33:27.265117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.265059 2556 factory.go:153] Registering CRI-O factory Jul 15 22:33:27.265117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.265102 2556 factory.go:223] Registration of the crio container factory successfully Jul 15 22:33:27.265236 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.265168 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 22:33:27.265343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.265325 2556 factory.go:103] Registering Raw factory Jul 15 22:33:27.265387 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.265355 2556 manager.go:1196] Started watching for new ooms in manager Jul 15 22:33:27.266178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.266161 2556 manager.go:349] Starting recovery of all containers Jul 15 22:33:27.267862 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.263761 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-147.ec2.internal.18c2975826b5d085 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-147.ec2.internal,UID:ip-10-0-139-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-147.ec2.internal,},FirstTimestamp:2026-07-15 22:33:27.254503557 +0000 UTC m=+0.345154794,LastTimestamp:2026-07-15 22:33:27.254503557 +0000 UTC m=+0.345154794,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-147.ec2.internal,}" Jul 15 22:33:27.268087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.268035 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t2br6" Jul 15 22:33:27.269249 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.269224 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 22:33:27.269872 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.269845 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 22:33:27.274133 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.274106 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t2br6" Jul 15 22:33:27.279026 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.278822 2556 manager.go:354] Recovery completed Jul 15 22:33:27.283295 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.283282 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.285249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285227 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.285318 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285265 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.285318 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285282 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.285837 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285825 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 22:33:27.285881 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285839 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 22:33:27.285881 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285847 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.285881 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.285858 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:33:27.286738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.286723 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.286785 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.286758 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.286785 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.286769 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.287083 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.287070 2556 policy_none.go:49] "None policy: Start" Jul 15 22:33:27.287126 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.287089 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 22:33:27.287126 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.287100 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 22:33:27.287498 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.287425 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-147.ec2.internal.18c29758288ae78e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-147.ec2.internal,UID:ip-10-0-139-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-147.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-147.ec2.internal,},FirstTimestamp:2026-07-15 22:33:27.285245838 +0000 UTC m=+0.375897079,LastTimestamp:2026-07-15 22:33:27.285245838 +0000 UTC m=+0.375897079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-147.ec2.internal,}" Jul 15 22:33:27.288185 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.288174 2556 policy_none.go:47] "Start" Jul 15 22:33:27.334500 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.334482 2556 manager.go:337] "Starting Device Plugin manager" Jul 15 22:33:27.334611 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.334516 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 22:33:27.334611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.334528 2556 server.go:87] "Starting device plugin registration server" Jul 15 22:33:27.334832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.334818 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 22:33:27.334929 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.334833 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 22:33:27.334979 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.334929 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 22:33:27.335025 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.335005 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 22:33:27.335025 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.335013 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 22:33:27.335596 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.335572 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 22:33:27.335693 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.335631 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.395885 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.395847 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 22:33:27.397218 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.397177 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 22:33:27.397276 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.397229 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 22:33:27.397276 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.397260 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 22:33:27.397342 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.397302 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 22:33:27.399565 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.399539 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:27.435459 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.435420 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.436729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.436668 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.436729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.436704 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.436729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.436716 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.436982 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.436739 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.443320 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.443299 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.443401 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.443328 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-147.ec2.internal\": node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.458083 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.458054 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.497616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.497575 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"] Jul 15 22:33:27.497803 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.497662 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.498683 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.498665 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.498781 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.498701 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.498781 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.498715 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.500150 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500133 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.500251 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.500314 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500271 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.500919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500887 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.500919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500915 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.501049 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500939 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.501049 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500940 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.501049 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500951 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.501049 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.500955 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.502239 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.502219 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.502328 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.502246 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:33:27.502928 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.502894 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:33:27.503010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.502940 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:33:27.503010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.502957 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:33:27.524945 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.524895 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-147.ec2.internal\" not found" node="ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.529699 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.529676 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-147.ec2.internal\" not found" node="ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.558507 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.558474 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.564987 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.564951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.565131 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.564991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fa1b573b1bff3bbe3f49d2310b1a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"9fa1b573b1bff3bbe3f49d2310b1a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.565131 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.565017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.659363 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.659331 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.665803 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.665919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.665919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fa1b573b1bff3bbe3f49d2310b1a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"9fa1b573b1bff3bbe3f49d2310b1a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.665919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665876 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.665919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665884 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02df77f8e782e2edef6cb31070a11871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal\" (UID: \"02df77f8e782e2edef6cb31070a11871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.665919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.665944 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fa1b573b1bff3bbe3f49d2310b1a627-config\") pod \"kube-apiserver-proxy-ip-10-0-139-147.ec2.internal\" (UID: \"9fa1b573b1bff3bbe3f49d2310b1a627\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.760272 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.760228 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.827817 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.827777 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.832426 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:27.832403 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:27.861212 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.861178 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:27.961771 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:27.961733 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:28.065683 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.065602 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:28.168689 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.168654 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-147.ec2.internal\" not found" Jul 15 22:33:28.211715 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.211665 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 22:33:28.212377 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.211877 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 22:33:28.234967 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.234940 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:28.246081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.246053 2556 apiserver.go:52] "Watching apiserver" Jul 15 22:33:28.254718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.254691 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:28.258270 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.258252 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 22:33:28.260870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.260849 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-fpv6x","openshift-multus/multus-xpwbt","openshift-multus/network-metrics-daemon-dlpr2","openshift-network-diagnostics/network-check-target-74kgh","openshift-ovn-kubernetes/ovnkube-node-wcj56","kube-system/konnectivity-agent-fr6zt","openshift-cluster-node-tuning-operator/tuned-rl8dg","openshift-image-registry/node-ca-gfkwh","openshift-network-operator/iptables-alerter-sps6d","kube-system/global-pull-secret-syncer-q7ggw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl","openshift-dns/node-resolver-b7d2d"] Jul 15 22:33:28.261370 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.261355 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" Jul 15 22:33:28.261417 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.261397 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 22:33:28.262742 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.262727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.263767 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.263746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.264734 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.264720 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.264815 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.264792 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:28.265208 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.265194 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 22:33:28.265809 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.265793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:28.265869 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.265851 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:28.266219 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266193 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 22:33:28.266294 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.266435 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266410 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 22:33:28.266435 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266429 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x2cfq\"" Jul 15 22:33:28.266596 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266523 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.266725 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266709 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f2xcr\"" Jul 15 22:33:28.266766 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.266709 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 22:33:28.267156 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.267143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.268517 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.268495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.269630 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.269610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270114 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270146 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-socket-dir-parent\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-netns\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-etc-kubernetes\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59m5h\" (UniqueName: \"kubernetes.io/projected/5aea217f-627d-427d-9b70-2fb27ff841d2-kube-api-access-59m5h\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-cnibin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-multus-certs\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-system-cni-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k8fgx\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270667 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-cni-binary-copy\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-multus\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270951 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.270972 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-os-release\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271429 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.270303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-k8s-cni-cncf-io\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-kubelet\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-daemon-config\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98srr\" (UniqueName: \"kubernetes.io/projected/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-kube-api-access-98srr\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-cnibin\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km449\" (UniqueName: \"kubernetes.io/projected/f761c195-7c70-4aeb-91e3-08323df18fbf-kube-api-access-km449\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-bin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271823 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-conf-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271855 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-os-release\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.271947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-hostroot\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.272025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.272055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-system-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.272522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.272370 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 22:33:28.273209 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.272544 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 22:33:28.273209 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.272709 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p4dcz\"" Jul 15 22:33:28.273461 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.273443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.274407 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.274379 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.274511 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.274385 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.274511 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.274439 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dm6xr\"" Jul 15 22:33:28.274768 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.274747 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:33:28.274851 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.274837 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" Jul 15 22:33:28.275907 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.275891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.276839 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.276821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.276915 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.276837 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.277161 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277136 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:33:28.277272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277161 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jv2n\"" Jul 15 22:33:28.277272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277169 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 22:33:28.277370 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277354 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.277491 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.277466 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:28.277592 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277508 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 22:28:27 +0000 UTC" deadline="2027-12-20 02:48:36.592366032 +0000 UTC" Jul 15 22:33:28.277592 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.277544 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12532h15m8.314824912s" Jul 15 22:33:28.278520 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.278499 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.278618 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.278518 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sm94g\"" Jul 15 22:33:28.278618 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.278565 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.278733 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.278623 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.278733 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.278675 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 22:33:28.280266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.279876 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal"] Jul 15 22:33:28.280266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.279970 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.282734 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.282715 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 22:33:28.282832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.282716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.282962 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.282946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.283085 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.283069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pqf7d\"" Jul 15 22:33:28.283220 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.283204 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 22:33:28.283273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.283258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5hwx8\"" Jul 15 22:33:28.283683 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.283666 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 22:33:28.283973 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.283938 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:33:28.284092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.284077 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal"] Jul 15 22:33:28.295735 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.295711 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5plc" Jul 15 22:33:28.303674 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.303656 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5plc" Jul 15 22:33:28.365036 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.365011 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 22:33:28.372694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.372656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-etc-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.372992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.372714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e82cf6d-9b0f-49a0-929e-b00336a2b395-agent-certs\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.373145 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.372998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-sys\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.373145 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-cnibin\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.373145 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km449\" (UniqueName: \"kubernetes.io/projected/f761c195-7c70-4aeb-91e3-08323df18fbf-kube-api-access-km449\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efee81a9-e685-4bb5-8af5-1e9cee654f42-serviceca\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-slash\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-systemd\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.373322 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4vl\" (UniqueName: \"kubernetes.io/projected/b516762b-6669-4fdb-8b4a-614bd60dfd6e-kube-api-access-ln4vl\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-bin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373410 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-cnibin\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-device-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-config\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.373629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373619 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysconfig\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-lib-modules\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373693 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-os-release\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-env-overrides\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-modprobe-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-conf\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-host\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-tmp\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-hostroot\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d222974c-6afe-4950-97c6-1c036daceeea-tmp-dir\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.374014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jwk\" (UniqueName: \"kubernetes.io/projected/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-kube-api-access-h2jwk\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e82cf6d-9b0f-49a0-929e-b00336a2b395-konnectivity-ca\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-socket-dir-parent\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-netns\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-kubelet-config\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-netns\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-netd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-run\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-system-cni-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d2d\" (UniqueName: \"kubernetes.io/projected/d222974c-6afe-4950-97c6-1c036daceeea-kube-api-access-l8d2d\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-systemd-units\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374527 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-cni-binary-copy\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.374572 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-multus\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-kubernetes\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.373471 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-bin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-cni-multus\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-os-release\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.374939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-registration-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375061 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-socket-dir-parent\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n6c\" (UniqueName: \"kubernetes.io/projected/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kube-api-access-d6n6c\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-log-socket\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-var-lib-kubelet\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-k8s-cni-cncf-io\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-kubelet\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-hostroot\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375312 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-system-cni-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375355 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-netns\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.375720 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-daemon-config\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375438 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-cni-binary-copy\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98srr\" (UniqueName: \"kubernetes.io/projected/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-kube-api-access-98srr\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72346f4a-319e-4c58-8b6b-dbe158fb47ab-host-slash\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.375529 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375578 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-os-release\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-os-release\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.375726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:28.875700947 +0000 UTC m=+1.966352188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-var-lib-kubelet\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.375826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-k8s-cni-cncf-io\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkkzb\" (UniqueName: \"kubernetes.io/projected/72346f4a-319e-4c58-8b6b-dbe158fb47ab-kube-api-access-bkkzb\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-daemon-config\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-systemd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-conf-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72346f4a-319e-4c58-8b6b-dbe158fb47ab-iptables-alerter-script\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-socket-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.376611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-node-log\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-bin\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-multus-conf-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8mcq\" (UniqueName: \"kubernetes.io/projected/efee81a9-e685-4bb5-8af5-1e9cee654f42-kube-api-access-k8mcq\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-system-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-etc-kubernetes\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376952 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f761c195-7c70-4aeb-91e3-08323df18fbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.376990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-etc-kubernetes\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377009 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-system-cni-dir\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59m5h\" (UniqueName: \"kubernetes.io/projected/5aea217f-627d-427d-9b70-2fb27ff841d2-kube-api-access-59m5h\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-dbus\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377176 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-cnibin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-multus-certs\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377360 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.377773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-sys-fs\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d222974c-6afe-4950-97c6-1c036daceeea-hosts-file\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-cnibin\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377495 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5aea217f-627d-427d-9b70-2fb27ff841d2-host-run-multus-certs\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-tuned\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-kubelet\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-var-lib-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-ovn\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-script-lib\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.377890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efee81a9-e685-4bb5-8af5-1e9cee654f42-host\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.378347 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.378328 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f761c195-7c70-4aeb-91e3-08323df18fbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.379786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.379751 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 22:33:28.383873 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.383833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km449\" (UniqueName: \"kubernetes.io/projected/f761c195-7c70-4aeb-91e3-08323df18fbf-kube-api-access-km449\") pod \"multus-additional-cni-plugins-fpv6x\" (UID: \"f761c195-7c70-4aeb-91e3-08323df18fbf\") " pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.384627 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.384604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98srr\" (UniqueName: \"kubernetes.io/projected/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-kube-api-access-98srr\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.388934 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.388907 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59m5h\" (UniqueName: \"kubernetes.io/projected/5aea217f-627d-427d-9b70-2fb27ff841d2-kube-api-access-59m5h\") pod \"multus-xpwbt\" (UID: \"5aea217f-627d-427d-9b70-2fb27ff841d2\") " pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.434274 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.434241 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:28.478894 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.478862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72346f4a-319e-4c58-8b6b-dbe158fb47ab-iptables-alerter-script\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.478894 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.478901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-socket-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.478939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-node-log\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.478962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-bin\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.478989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8mcq\" (UniqueName: \"kubernetes.io/projected/efee81a9-e685-4bb5-8af5-1e9cee654f42-kube-api-access-k8mcq\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479040 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-dbus\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-bin\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479162 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-node-log\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-sys-fs\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479201 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-socket-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d222974c-6afe-4950-97c6-1c036daceeea-hosts-file\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-tuned\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479263 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d222974c-6afe-4950-97c6-1c036daceeea-hosts-file\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-dbus\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.479172 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-sys-fs\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-kubelet\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479318 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-kubelet\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-var-lib-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479264 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-etc-selinux\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.479347 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:28.979323795 +0000 UTC m=+2.069975026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479362 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-var-lib-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-ovn\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.479617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-script-lib\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efee81a9-e685-4bb5-8af5-1e9cee654f42-host\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-ovn\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-etc-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-etc-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479564 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efee81a9-e685-4bb5-8af5-1e9cee654f42-host\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e82cf6d-9b0f-49a0-929e-b00336a2b395-agent-certs\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72346f4a-319e-4c58-8b6b-dbe158fb47ab-iptables-alerter-script\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-sys\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efee81a9-e685-4bb5-8af5-1e9cee654f42-serviceca\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-slash\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479703 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-sys\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479769 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-slash\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-systemd\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4vl\" (UniqueName: \"kubernetes.io/projected/b516762b-6669-4fdb-8b4a-614bd60dfd6e-kube-api-access-ln4vl\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-systemd\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-device-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.480527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479896 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-openvswitch\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-config\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479973 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-device-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.479993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysconfig\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-lib-modules\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-env-overrides\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-modprobe-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-conf\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-host\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-tmp\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d222974c-6afe-4950-97c6-1c036daceeea-tmp-dir\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jwk\" (UniqueName: \"kubernetes.io/projected/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-kube-api-access-h2jwk\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-script-lib\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e82cf6d-9b0f-49a0-929e-b00336a2b395-konnectivity-ca\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.481636 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-kubelet-config\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-netns\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-netd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-run\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480451 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d2d\" (UniqueName: \"kubernetes.io/projected/d222974c-6afe-4950-97c6-1c036daceeea-kube-api-access-l8d2d\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-systemd-units\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-kubernetes\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480569 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysconfig\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-registration-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n6c\" (UniqueName: \"kubernetes.io/projected/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kube-api-access-d6n6c\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-log-socket\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-lib-modules\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-var-lib-kubelet\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480738 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovnkube-config\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480757 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-var-lib-kubelet\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.482464 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72346f4a-319e-4c58-8b6b-dbe158fb47ab-host-slash\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72346f4a-319e-4c58-8b6b-dbe158fb47ab-host-slash\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480809 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-env-overrides\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkkzb\" (UniqueName: \"kubernetes.io/projected/72346f4a-319e-4c58-8b6b-dbe158fb47ab-kube-api-access-bkkzb\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-modprobe-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-systemd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-run-netns\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480934 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-log-socket\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-run-systemd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.480978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-conf\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efee81a9-e685-4bb5-8af5-1e9cee654f42-serviceca\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-host-cni-netd\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481237 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17ae4e00-2ba9-46f7-9acb-d55f832c8059-registration-dir\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d222974c-6afe-4950-97c6-1c036daceeea-tmp-dir\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.483174 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481453 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-kubelet-config\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481533 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-run\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481607 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-host\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-sysctl-d\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481670 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-kubernetes\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.481719 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-systemd-units\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.482019 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e82cf6d-9b0f-49a0-929e-b00336a2b395-konnectivity-ca\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.482909 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.483419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-etc-tuned\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.483826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.483543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e82cf6d-9b0f-49a0-929e-b00336a2b395-agent-certs\") pod \"konnectivity-agent-fr6zt\" (UID: \"3e82cf6d-9b0f-49a0-929e-b00336a2b395\") " pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.484143 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.483856 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b516762b-6669-4fdb-8b4a-614bd60dfd6e-tmp\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.490451 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.490382 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:28.490451 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.490420 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:28.490451 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.490448 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:28.490773 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.490536 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:33:28.990515531 +0000 UTC m=+2.081166771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:28.491378 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.491344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4vl\" (UniqueName: \"kubernetes.io/projected/b516762b-6669-4fdb-8b4a-614bd60dfd6e-kube-api-access-ln4vl\") pod \"tuned-rl8dg\" (UID: \"b516762b-6669-4fdb-8b4a-614bd60dfd6e\") " pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.491521 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.491500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8mcq\" (UniqueName: \"kubernetes.io/projected/efee81a9-e685-4bb5-8af5-1e9cee654f42-kube-api-access-k8mcq\") pod \"node-ca-gfkwh\" (UID: \"efee81a9-e685-4bb5-8af5-1e9cee654f42\") " pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.492139 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.492113 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d2d\" (UniqueName: \"kubernetes.io/projected/d222974c-6afe-4950-97c6-1c036daceeea-kube-api-access-l8d2d\") pod \"node-resolver-b7d2d\" (UID: \"d222974c-6afe-4950-97c6-1c036daceeea\") " pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.492441 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.492424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkkzb\" (UniqueName: \"kubernetes.io/projected/72346f4a-319e-4c58-8b6b-dbe158fb47ab-kube-api-access-bkkzb\") pod \"iptables-alerter-sps6d\" (UID: \"72346f4a-319e-4c58-8b6b-dbe158fb47ab\") " pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.492902 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.492885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n6c\" (UniqueName: \"kubernetes.io/projected/17ae4e00-2ba9-46f7-9acb-d55f832c8059-kube-api-access-d6n6c\") pod \"aws-ebs-csi-driver-node-8pxbl\" (UID: \"17ae4e00-2ba9-46f7-9acb-d55f832c8059\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.493472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.493448 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jwk\" (UniqueName: \"kubernetes.io/projected/cbf5c601-7dc1-444e-9c5a-9ef0621352ba-kube-api-access-h2jwk\") pod \"ovnkube-node-wcj56\" (UID: \"cbf5c601-7dc1-444e-9c5a-9ef0621352ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.499254 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.499223 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02df77f8e782e2edef6cb31070a11871.slice/crio-9f85953fe477eba4faa39254b2b4ffc17414fd0788df846f4e418e5fa7c18104 WatchSource:0}: Error finding container 9f85953fe477eba4faa39254b2b4ffc17414fd0788df846f4e418e5fa7c18104: Status 404 returned error can't find the container with id 9f85953fe477eba4faa39254b2b4ffc17414fd0788df846f4e418e5fa7c18104 Jul 15 22:33:28.499428 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.499414 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa1b573b1bff3bbe3f49d2310b1a627.slice/crio-01113674ad13a437991de32c91a43d258a12f962be44f6eaf1cb6d14f312bd15 WatchSource:0}: Error finding container 01113674ad13a437991de32c91a43d258a12f962be44f6eaf1cb6d14f312bd15: Status 404 returned error can't find the container with id 01113674ad13a437991de32c91a43d258a12f962be44f6eaf1cb6d14f312bd15 Jul 15 22:33:28.505798 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.505779 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:33:28.585145 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.585044 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" Jul 15 22:33:28.594403 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.594374 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf761c195_7c70_4aeb_91e3_08323df18fbf.slice/crio-7b76f97aebb1070a22d03827d18244919c968d366f338fc0cb71323c8862ab70 WatchSource:0}: Error finding container 7b76f97aebb1070a22d03827d18244919c968d366f338fc0cb71323c8862ab70: Status 404 returned error can't find the container with id 7b76f97aebb1070a22d03827d18244919c968d366f338fc0cb71323c8862ab70 Jul 15 22:33:28.605366 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.605339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sps6d" Jul 15 22:33:28.613453 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.613428 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72346f4a_319e_4c58_8b6b_dbe158fb47ab.slice/crio-837e924f0edce0c2d924325e5f2998a448073a961a6d988dadba1fad114cee54 WatchSource:0}: Error finding container 837e924f0edce0c2d924325e5f2998a448073a961a6d988dadba1fad114cee54: Status 404 returned error can't find the container with id 837e924f0edce0c2d924325e5f2998a448073a961a6d988dadba1fad114cee54 Jul 15 22:33:28.622229 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.622204 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpwbt" Jul 15 22:33:28.630162 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.630138 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aea217f_627d_427d_9b70_2fb27ff841d2.slice/crio-d66eb2b897cb775dbf59652ae3e1592cea861e1668be9b2964c77e4330158d49 WatchSource:0}: Error finding container d66eb2b897cb775dbf59652ae3e1592cea861e1668be9b2964c77e4330158d49: Status 404 returned error can't find the container with id d66eb2b897cb775dbf59652ae3e1592cea861e1668be9b2964c77e4330158d49 Jul 15 22:33:28.638670 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.638646 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:28.646969 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.646938 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf5c601_7dc1_444e_9c5a_9ef0621352ba.slice/crio-cafc6713ac0a1014a551b765ba22cc8c32de15a70508832e2876fc137f27a1eb WatchSource:0}: Error finding container cafc6713ac0a1014a551b765ba22cc8c32de15a70508832e2876fc137f27a1eb: Status 404 returned error can't find the container with id cafc6713ac0a1014a551b765ba22cc8c32de15a70508832e2876fc137f27a1eb Jul 15 22:33:28.653804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.653783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:28.661655 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.661630 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e82cf6d_9b0f_49a0_929e_b00336a2b395.slice/crio-17810c20d6da6ae532df9cbb71c55bdd7bc1bfc7494aec07dc7c240fafef8e70 WatchSource:0}: Error finding container 17810c20d6da6ae532df9cbb71c55bdd7bc1bfc7494aec07dc7c240fafef8e70: Status 404 returned error can't find the container with id 17810c20d6da6ae532df9cbb71c55bdd7bc1bfc7494aec07dc7c240fafef8e70 Jul 15 22:33:28.680980 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.680947 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" Jul 15 22:33:28.689104 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.689057 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb516762b_6669_4fdb_8b4a_614bd60dfd6e.slice/crio-743ff5703779ad49565f931a3d09376b9eb8a99aa9004f7671a4e69f8b035950 WatchSource:0}: Error finding container 743ff5703779ad49565f931a3d09376b9eb8a99aa9004f7671a4e69f8b035950: Status 404 returned error can't find the container with id 743ff5703779ad49565f931a3d09376b9eb8a99aa9004f7671a4e69f8b035950 Jul 15 22:33:28.719160 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.719115 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gfkwh" Jul 15 22:33:28.725413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.725294 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" Jul 15 22:33:28.726379 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.726360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b7d2d" Jul 15 22:33:28.728131 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.728104 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefee81a9_e685_4bb5_8af5_1e9cee654f42.slice/crio-ec74a25057cbe4b07d84c26110d0ce2bf63d5c80df62906d78afacd777525b2a WatchSource:0}: Error finding container ec74a25057cbe4b07d84c26110d0ce2bf63d5c80df62906d78afacd777525b2a: Status 404 returned error can't find the container with id ec74a25057cbe4b07d84c26110d0ce2bf63d5c80df62906d78afacd777525b2a Jul 15 22:33:28.737604 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:33:28.737580 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd222974c_6afe_4950_97c6_1c036daceeea.slice/crio-4db28f27b323bd15a24fbe293a483bf378006b28415707f6823bd2d2e2f8102b WatchSource:0}: Error finding container 4db28f27b323bd15a24fbe293a483bf378006b28415707f6823bd2d2e2f8102b: Status 404 returned error can't find the container with id 4db28f27b323bd15a24fbe293a483bf378006b28415707f6823bd2d2e2f8102b Jul 15 22:33:28.883015 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.882934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:28.883155 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.883078 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:28.883155 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.883145 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:29.883124657 +0000 UTC m=+2.973775879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:28.983434 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:28.983389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:28.983635 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.983587 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:28.983707 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:28.983665 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:29.983641524 +0000 UTC m=+3.074292750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:29.084420 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.084372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:29.084677 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.084652 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:29.084677 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.084687 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:29.084838 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.084699 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:29.084838 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.084753 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:33:30.084736886 +0000 UTC m=+3.175388127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:29.306136 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.305998 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:28:28 +0000 UTC" deadline="2028-04-27 09:22:01.360930524 +0000 UTC" Jul 15 22:33:29.306136 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.306074 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15634h48m32.054861091s" Jul 15 22:33:29.433424 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.414203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" event={"ID":"9fa1b573b1bff3bbe3f49d2310b1a627","Type":"ContainerStarted","Data":"01113674ad13a437991de32c91a43d258a12f962be44f6eaf1cb6d14f312bd15"} Jul 15 22:33:29.447937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.444242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7d2d" event={"ID":"d222974c-6afe-4950-97c6-1c036daceeea","Type":"ContainerStarted","Data":"4db28f27b323bd15a24fbe293a483bf378006b28415707f6823bd2d2e2f8102b"} Jul 15 22:33:29.470243 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.469152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gfkwh" event={"ID":"efee81a9-e685-4bb5-8af5-1e9cee654f42","Type":"ContainerStarted","Data":"ec74a25057cbe4b07d84c26110d0ce2bf63d5c80df62906d78afacd777525b2a"} Jul 15 22:33:29.483062 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.481275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fr6zt" event={"ID":"3e82cf6d-9b0f-49a0-929e-b00336a2b395","Type":"ContainerStarted","Data":"17810c20d6da6ae532df9cbb71c55bdd7bc1bfc7494aec07dc7c240fafef8e70"} Jul 15 22:33:29.494785 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.494062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"cafc6713ac0a1014a551b765ba22cc8c32de15a70508832e2876fc137f27a1eb"} Jul 15 22:33:29.505753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.505645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sps6d" event={"ID":"72346f4a-319e-4c58-8b6b-dbe158fb47ab","Type":"ContainerStarted","Data":"837e924f0edce0c2d924325e5f2998a448073a961a6d988dadba1fad114cee54"} Jul 15 22:33:29.523724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.523684 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerStarted","Data":"7b76f97aebb1070a22d03827d18244919c968d366f338fc0cb71323c8862ab70"} Jul 15 22:33:29.535603 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.535408 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"02df77f8e782e2edef6cb31070a11871","Type":"ContainerStarted","Data":"9f85953fe477eba4faa39254b2b4ffc17414fd0788df846f4e418e5fa7c18104"} Jul 15 22:33:29.541050 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.541010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" event={"ID":"17ae4e00-2ba9-46f7-9acb-d55f832c8059","Type":"ContainerStarted","Data":"362efedd0a1fd570afe74f40d721a3d73d2d27b658ab54d90844aa5fe0716900"} Jul 15 22:33:29.545826 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.544263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" event={"ID":"b516762b-6669-4fdb-8b4a-614bd60dfd6e","Type":"ContainerStarted","Data":"743ff5703779ad49565f931a3d09376b9eb8a99aa9004f7671a4e69f8b035950"} Jul 15 22:33:29.551171 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.551133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpwbt" event={"ID":"5aea217f-627d-427d-9b70-2fb27ff841d2","Type":"ContainerStarted","Data":"d66eb2b897cb775dbf59652ae3e1592cea861e1668be9b2964c77e4330158d49"} Jul 15 22:33:29.705711 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.705543 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:33:29.892449 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.892407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:29.892665 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.892594 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:29.892665 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.892658 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:31.892641474 +0000 UTC m=+4.983292712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:29.994199 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:29.994151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:29.994426 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.994362 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:29.994507 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:29.994427 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:31.994406586 +0000 UTC m=+5.085057811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:30.094696 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.094650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:30.094889 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.094831 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:30.094889 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.094855 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:30.094889 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.094868 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:30.095149 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.094941 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:33:32.094918552 +0000 UTC m=+5.185569803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:30.306566 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.306515 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:28:28 +0000 UTC" deadline="2028-02-01 06:19:09.856482158 +0000 UTC" Jul 15 22:33:30.306566 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.306563 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13567h45m39.549924233s" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.400227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.400384 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.400873 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.401021 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:30.401092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:30.401233 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:30.401176 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:31.912595 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:31.911805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:31.912595 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:31.912078 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:31.912595 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:31.912172 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:35.912147326 +0000 UTC m=+9.002798569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:32.012855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:32.012813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:32.013167 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.012968 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:32.013167 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.013065 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:36.013034391 +0000 UTC m=+9.103685621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:32.113664 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:32.113624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:32.113878 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.113818 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:32.113878 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.113839 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:32.113878 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.113853 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:32.114153 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.113912 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:33:36.113892358 +0000 UTC m=+9.204543585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:32.397823 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:32.397784 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:32.398048 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.397953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:32.398443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:32.398416 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:32.398553 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.398529 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:32.398640 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:32.398607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:32.398725 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:32.398710 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:34.397867 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:34.397829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:34.398439 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:34.397888 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:34.398439 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:34.397987 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:34.398439 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:34.398007 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:34.398439 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:34.398119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:34.398439 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:34.398192 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:35.951658 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:35.951610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:35.958423 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:35.955752 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:35.958423 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:35.955831 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:43.955814281 +0000 UTC m=+17.046465503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:36.052817 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:36.052765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:36.053037 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.052969 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:36.053115 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.053097 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:33:44.053074849 +0000 UTC m=+17.143726095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:36.153304 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:36.153249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:36.153497 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.153447 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:36.153497 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.153468 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:36.153497 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.153482 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:36.153671 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.153543 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:33:44.153524743 +0000 UTC m=+17.244175969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:36.400195 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:36.400160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:36.400369 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:36.400177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:36.400369 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.400278 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:36.400369 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:36.400341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:36.400526 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.400421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:36.400526 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:36.400475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:38.398204 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:38.398168 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:38.398672 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:38.398317 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:38.398750 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:38.398687 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:38.398804 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:38.398778 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:38.398864 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:38.398816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:38.398957 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:38.398933 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:40.398336 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:40.398298 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:40.398336 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:40.398327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:40.398784 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:40.398352 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:40.398784 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:40.398426 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:40.398784 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:40.398570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:40.398784 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:40.398682 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:42.397666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:42.397630 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:42.398143 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:42.397748 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:42.398143 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:42.397760 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:42.398143 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:42.397786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:42.398143 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:42.397894 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:42.398143 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:42.398019 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:44.017957 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.017893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:44.018377 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.018100 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:44.018377 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.018188 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.018165442 +0000 UTC m=+33.108816670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:33:44.118660 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.118623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:44.118814 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.118733 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:44.118814 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.118787 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.118774819 +0000 UTC m=+33.209426039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:33:44.219760 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.219718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:44.219968 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.219922 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:33:44.219968 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.219948 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:33:44.219968 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.219962 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:44.220121 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.220029 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:34:00.220010261 +0000 UTC m=+33.310661505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:33:44.397557 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.397469 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:44.397804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.397593 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:44.397804 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.397602 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:44.397804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:44.397627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:44.397804 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.397726 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:44.398044 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:44.397830 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:46.398031 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:46.398085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:46.398085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:46.398160 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:46.398275 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:46.398509 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:46.398360 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:48.398415 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:48.398368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:48.398415 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:48.398415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:48.398851 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:48.398371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:48.398851 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:48.398483 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:48.398851 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:48.398623 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:48.398851 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:48.398722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:50.398536 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.398347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:50.398852 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.398403 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:50.398852 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:50.398619 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:50.398852 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:50.398688 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:50.398852 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.398412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:50.398852 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:50.398772 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:50.603394 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.603370 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:33:50.603818 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.603795 2556 generic.go:356] "Generic (PLEG): container finished" podID="cbf5c601-7dc1-444e-9c5a-9ef0621352ba" containerID="898d16c1ba86d654df5a8b9c933821cbe9b220267940bd03e7dcbc45c2c33fca" exitCode=1 Jul 15 22:33:50.603895 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.603866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"b710b65578eb2c9b7a913e47db878b34329ec8e3644bb74b48d60f0fd84a1749"} Jul 15 22:33:50.603977 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.603961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"533bb3a40fe82dd4e68b2242e0f8c03ed94e40bbd53f26f6bc7edfaba0fed4fa"} Jul 15 22:33:50.604033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.604020 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerDied","Data":"898d16c1ba86d654df5a8b9c933821cbe9b220267940bd03e7dcbc45c2c33fca"} Jul 15 22:33:50.604084 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.604072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"82b8cb5eb14eab9130b4186532115c8da6ea4e8a96f1a7cae79560d3f6aec18d"} Jul 15 22:33:50.605530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.605499 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" event={"ID":"b516762b-6669-4fdb-8b4a-614bd60dfd6e","Type":"ContainerStarted","Data":"84019a6cd1a707b4674fb8697bc3d4d4779c2ebd13648ed2809b14c6b6b29e85"} Jul 15 22:33:50.607085 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.607057 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpwbt" event={"ID":"5aea217f-627d-427d-9b70-2fb27ff841d2","Type":"ContainerStarted","Data":"2b38314b091b26e9b4645218850e1e3fa283f115d4269a701eaba2e4382183f7"} Jul 15 22:33:50.608579 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.608557 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" event={"ID":"9fa1b573b1bff3bbe3f49d2310b1a627","Type":"ContainerStarted","Data":"aa29a31b08192515c760b5ec78462c2faca364e0eb52a5e05c7550f1629ea88d"} Jul 15 22:33:50.625998 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.625954 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rl8dg" podStartSLOduration=1.312355466 podStartE2EDuration="22.625937799s" totalImagesPullingTime="21.313582333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:50.625470861 +0000 UTC m=+23.716122115" watchObservedRunningTime="2026-07-15 22:33:50.625937799 +0000 UTC m=+23.716589042" Jul 15 22:33:50.657377 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.657326 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xpwbt" podStartSLOduration=1.284461733 podStartE2EDuration="22.657309706s" totalImagesPullingTime="21.372847973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:50.657146208 +0000 UTC m=+23.747797452" watchObservedRunningTime="2026-07-15 22:33:50.657309706 +0000 UTC m=+23.747960949" Jul 15 22:33:50.657755 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:50.657735 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-147.ec2.internal" podStartSLOduration=22.657727168 podStartE2EDuration="22.657727168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:50.639854679 +0000 UTC m=+23.730505921" watchObservedRunningTime="2026-07-15 22:33:50.657727168 +0000 UTC m=+23.748378412" Jul 15 22:33:51.612086 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.611752 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b7d2d" event={"ID":"d222974c-6afe-4950-97c6-1c036daceeea","Type":"ContainerStarted","Data":"ae8a5b48712d8d3ca45cf1427cbdb7c3f77a8720759bc6ca5b798e06cd325eca"} Jul 15 22:33:51.613236 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.613213 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gfkwh" event={"ID":"efee81a9-e685-4bb5-8af5-1e9cee654f42","Type":"ContainerStarted","Data":"60e7e5ebbc895b72a07e617931a645198283c287590f09a7158a6a981567a4fd"} Jul 15 22:33:51.614539 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.614509 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fr6zt" event={"ID":"3e82cf6d-9b0f-49a0-929e-b00336a2b395","Type":"ContainerStarted","Data":"bdba4511aca3a08e8477a5ec7bae282965a6602dd4ff6da354cfb77f276efe46"} Jul 15 22:33:51.617229 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.617210 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:33:51.617578 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.617559 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"e3b2e45d6040f7810e19d158369b2bc7ad26bdae4b07d2fb3a60bbbf5e46709e"} Jul 15 22:33:51.617645 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.617611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"60c30483cdd79aef7d3d450cf26d6be54c796cb93ebd4796f76a5b164691bcf6"} Jul 15 22:33:51.618830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.618809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sps6d" event={"ID":"72346f4a-319e-4c58-8b6b-dbe158fb47ab","Type":"ContainerStarted","Data":"f80a9ff416e9d949c78ba80d428c9f265778b68cb9a1241878db9f557b108bc8"} Jul 15 22:33:51.620529 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.620506 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="50bd19eb917779925b4e8de0173bd5a3071bb5d7335b02f11593e8ed12ed7e9b" exitCode=0 Jul 15 22:33:51.620614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.620590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"50bd19eb917779925b4e8de0173bd5a3071bb5d7335b02f11593e8ed12ed7e9b"} Jul 15 22:33:51.622376 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.622350 2556 generic.go:356] "Generic (PLEG): container finished" podID="02df77f8e782e2edef6cb31070a11871" containerID="7bb493997ab1e6f5425163b636c0c21aa4a690c27058ff59d8150676a354892f" exitCode=0 Jul 15 22:33:51.622472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.622454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"02df77f8e782e2edef6cb31070a11871","Type":"ContainerDied","Data":"7bb493997ab1e6f5425163b636c0c21aa4a690c27058ff59d8150676a354892f"} Jul 15 22:33:51.626759 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.626735 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" event={"ID":"17ae4e00-2ba9-46f7-9acb-d55f832c8059","Type":"ContainerStarted","Data":"578bb9cd8c32708019fcebd033a99abe0b3a7c59a442b89ec276315b52356d38"} Jul 15 22:33:51.627221 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.627182 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b7d2d" podStartSLOduration=2.398266418 podStartE2EDuration="23.627170885s" totalImagesPullingTime="21.228904467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:51.627049742 +0000 UTC m=+24.717700998" watchObservedRunningTime="2026-07-15 22:33:51.627170885 +0000 UTC m=+24.717822127" Jul 15 22:33:51.643127 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.643032 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fr6zt" podStartSLOduration=2.33782191 podStartE2EDuration="23.643013048s" totalImagesPullingTime="21.305191138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:51.642428309 +0000 UTC m=+24.733079549" watchObservedRunningTime="2026-07-15 22:33:51.643013048 +0000 UTC m=+24.733664288" Jul 15 22:33:51.660182 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.660138 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gfkwh" podStartSLOduration=7.288291381 podStartE2EDuration="23.660121675s" totalImagesPullingTime="16.371830294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:51.659726363 +0000 UTC m=+24.750377606" watchObservedRunningTime="2026-07-15 22:33:51.660121675 +0000 UTC m=+24.750772972" Jul 15 22:33:51.711332 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:51.711279 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sps6d" podStartSLOduration=2.321863646 podStartE2EDuration="23.711263998s" totalImagesPullingTime="21.389400352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:51.711134122 +0000 UTC m=+24.801785366" watchObservedRunningTime="2026-07-15 22:33:51.711263998 +0000 UTC m=+24.801915240" Jul 15 22:33:52.108774 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.108736 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 22:33:52.348239 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.348126 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T22:33:52.108755273Z","UUID":"0a9b8bd5-f19f-48dd-95d5-b2abd049f1f3","Handler":null,"Name":"","Endpoint":""} Jul 15 22:33:52.349810 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.349785 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 22:33:52.349978 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.349834 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 22:33:52.398021 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.397945 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:52.398021 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.397971 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:52.398407 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.397955 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:52.398407 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:52.398070 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:52.398407 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:52.398181 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:52.398407 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:52.398276 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:52.636048 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.635944 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" event={"ID":"17ae4e00-2ba9-46f7-9acb-d55f832c8059","Type":"ContainerStarted","Data":"2d97e14bccd3de200544a26ad785d5613b929fc26da8a5a6c31fee714b01f5c5"} Jul 15 22:33:52.638964 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.638894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" event={"ID":"02df77f8e782e2edef6cb31070a11871","Type":"ContainerStarted","Data":"8812a444dbf83f257e19dab6e57954c5892e4e7642777782232f859feb6bde37"} Jul 15 22:33:52.992801 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.992771 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:52.993461 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:52.993441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:53.011387 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.011327 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-147.ec2.internal" podStartSLOduration=25.011293102 podStartE2EDuration="25.011293102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:52.657733077 +0000 UTC m=+25.748384320" watchObservedRunningTime="2026-07-15 22:33:53.011293102 +0000 UTC m=+26.101944346" Jul 15 22:33:53.498167 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.498074 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:53.498679 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.498651 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fr6zt" Jul 15 22:33:53.643068 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.643031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" event={"ID":"17ae4e00-2ba9-46f7-9acb-d55f832c8059","Type":"ContainerStarted","Data":"5b27c14ae541f341b1cb2116eca316d50147ce2c5930744376b7a9a34b53de7d"} Jul 15 22:33:53.646584 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.646557 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:33:53.647080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:53.647048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"04618b7d4439150b879631fa7baeb3b2afba447ed13c69563573401e5f3aaf3e"} Jul 15 22:33:54.397915 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:54.397860 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:54.398146 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:54.397998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:54.398146 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:54.398000 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:54.398146 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:54.398064 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:54.398309 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:54.398148 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:54.398309 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:54.398225 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:56.398208 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.397883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:56.398839 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.397944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:56.398839 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:56.398292 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:56.398839 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.397950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:56.398839 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:56.398323 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:56.398839 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:56.398419 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:56.659673 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.659594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:33:56.659967 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.659936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"12ab9829db977513c574bcb48fecb8b90a7b8c1533b4d6312964dcbb6199c098"} Jul 15 22:33:56.660266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.660243 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:56.660424 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.660407 2556 scope.go:117] "RemoveContainer" containerID="898d16c1ba86d654df5a8b9c933821cbe9b220267940bd03e7dcbc45c2c33fca" Jul 15 22:33:56.661739 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.661711 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="52b5726849cf6d7d14264da50034151bca6dc3733a30144c4d093e91fcdb8069" exitCode=0 Jul 15 22:33:56.661835 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.661758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"52b5726849cf6d7d14264da50034151bca6dc3733a30144c4d093e91fcdb8069"} Jul 15 22:33:56.677286 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.677263 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:56.698081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:56.698040 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8pxbl" podStartSLOduration=5.333709282 podStartE2EDuration="28.698024242s" totalImagesPullingTime="23.36431496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:53.661698982 +0000 UTC m=+26.752350238" watchObservedRunningTime="2026-07-15 22:33:56.698024242 +0000 UTC m=+29.788675486" Jul 15 22:33:57.668169 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.668142 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:33:57.668689 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.668516 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" event={"ID":"cbf5c601-7dc1-444e-9c5a-9ef0621352ba","Type":"ContainerStarted","Data":"48741243c9df55cf83e5626a932577d17294e550694ea70c0306b3a3645345fb"} Jul 15 22:33:57.668824 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.668799 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:57.668919 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.668887 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:57.685937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.685892 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:33:57.700702 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:57.700653 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" podStartSLOduration=8.279649454 podStartE2EDuration="29.700638816s" totalImagesPullingTime="21.420989362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:33:57.700120904 +0000 UTC m=+30.790772147" watchObservedRunningTime="2026-07-15 22:33:57.700638816 +0000 UTC m=+30.791290058" Jul 15 22:33:58.012221 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.012196 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7d2d_d222974c-6afe-4950-97c6-1c036daceeea/dns-node-resolver/0.log" Jul 15 22:33:58.149593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.149562 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7ggw"] Jul 15 22:33:58.149792 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.149676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:58.149792 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:58.149763 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:33:58.153078 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.153048 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dlpr2"] Jul 15 22:33:58.153208 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.153181 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:33:58.153327 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:58.153299 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:33:58.153709 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.153678 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74kgh"] Jul 15 22:33:58.153802 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.153764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:33:58.153850 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:58.153831 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:33:58.673033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.672997 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="09e9b9da8b9de9c0bdc1c2e48f358ec423dbd8907f7514c2cb82554e26711e98" exitCode=0 Jul 15 22:33:58.673447 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.673056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"09e9b9da8b9de9c0bdc1c2e48f358ec423dbd8907f7514c2cb82554e26711e98"} Jul 15 22:33:58.988080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:58.987889 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gfkwh_efee81a9-e685-4bb5-8af5-1e9cee654f42/node-ca/0.log" Jul 15 22:33:59.400756 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:33:59.400688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:33:59.400928 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:33:59.400804 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:00.035435 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.035341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:00.036047 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.035518 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:34:00.036047 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.035619 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs podName:69fa51a1-f78c-4236-9de4-d35f40fb4ff5 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:32.035599964 +0000 UTC m=+65.126251192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs") pod "network-metrics-daemon-dlpr2" (UID: "69fa51a1-f78c-4236-9de4-d35f40fb4ff5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:34:00.136030 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.135992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:00.136180 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.136108 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:34:00.136180 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.136165 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret podName:dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4 nodeName:}" failed. No retries permitted until 2026-07-15 22:34:32.136149897 +0000 UTC m=+65.226801122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret") pod "global-pull-secret-syncer-q7ggw" (UID: "dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:34:00.236729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.236689 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:00.236890 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.236856 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:34:00.236890 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.236872 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:34:00.236890 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.236882 2556 projected.go:196] Error preparing data for projected volume kube-api-access-clhld for pod openshift-network-diagnostics/network-check-target-74kgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:34:00.237054 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.236948 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld podName:a82af034-adb2-404d-af19-226f8702524e nodeName:}" failed. No retries permitted until 2026-07-15 22:34:32.236932496 +0000 UTC m=+65.327583737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-clhld" (UniqueName: "kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld") pod "network-check-target-74kgh" (UID: "a82af034-adb2-404d-af19-226f8702524e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:34:00.398472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.398366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:00.398617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.398374 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:00.398617 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.398525 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:00.398617 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:00.398552 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:00.679534 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.679450 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="31b2c55b43f307876b718f76d1eade8e5f4e983aecdf31609b396fc8695941f7" exitCode=0 Jul 15 22:34:00.679534 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:00.679495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"31b2c55b43f307876b718f76d1eade8e5f4e983aecdf31609b396fc8695941f7"} Jul 15 22:34:01.398019 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:01.397980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:01.398563 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:01.398113 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:02.397782 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:02.397744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:02.401417 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:02.398295 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:02.401417 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:02.398371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:02.401417 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:02.398501 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:03.397873 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:03.397839 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:03.398046 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:03.397988 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:04.397781 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:04.397727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:04.398425 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:04.397875 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:04.398425 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:04.398072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:04.398425 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:04.398179 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:05.398109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:05.398075 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:05.398516 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:05.398192 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:05.693786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:05.693697 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="b71f4bac77d9c5e855fd96c8101857e64f72c07d3b5d2b3332d2ba447c75fae7" exitCode=0 Jul 15 22:34:05.693786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:05.693754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"b71f4bac77d9c5e855fd96c8101857e64f72c07d3b5d2b3332d2ba447c75fae7"} Jul 15 22:34:06.398264 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:06.398223 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:06.398775 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:06.398331 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:06.398775 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:06.398387 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:06.398775 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:06.398478 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:06.699933 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:06.699831 2556 generic.go:356] "Generic (PLEG): container finished" podID="f761c195-7c70-4aeb-91e3-08323df18fbf" containerID="0668055b3f15307571edbfe7d12f8e3a603b799ee308288f4f61d7384bf727c4" exitCode=0 Jul 15 22:34:06.699933 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:06.699888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerDied","Data":"0668055b3f15307571edbfe7d12f8e3a603b799ee308288f4f61d7384bf727c4"} Jul 15 22:34:07.399323 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:07.399138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:07.399753 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:07.399402 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:07.704997 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:07.704862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" event={"ID":"f761c195-7c70-4aeb-91e3-08323df18fbf","Type":"ContainerStarted","Data":"3fde43b1606bd4e8240cb4f2d9b66d3930ad43a3c375d9ced8612c3d203fcaf3"} Jul 15 22:34:08.397722 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:08.397684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:08.397930 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:08.397690 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:08.397930 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:08.397789 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:08.397930 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:08.397874 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:09.397812 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:09.397773 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:09.398233 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:09.397882 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:10.398469 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:10.398433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:10.398881 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:10.398482 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:10.398881 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:10.398579 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:10.398881 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:10.398688 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:11.398172 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:11.398144 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:11.398336 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:11.398241 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:12.398116 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:12.398067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:12.398541 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:12.398067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:12.398541 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:12.398182 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:12.398541 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:12.398262 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:13.398017 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:13.397980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:13.398203 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:13.398090 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:14.398105 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:14.398061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:14.398105 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:14.398092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:14.398640 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:14.398200 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:14.398640 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:14.398306 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:15.398086 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:15.398051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:15.398253 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:15.398164 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:16.397968 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:16.397932 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:16.397968 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:16.397975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:16.398352 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:16.398058 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:16.398352 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:16.398170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:17.398781 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:17.398746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:17.399216 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:17.398866 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:18.398318 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:18.398284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:18.398509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:18.398286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:18.398509 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:18.398397 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:18.398583 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:18.398508 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:19.400773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:19.400742 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:19.401175 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:19.400845 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:20.398126 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:20.398091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:20.398380 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:20.398091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:20.398380 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:20.398191 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:20.398380 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:20.398275 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:21.397682 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:21.397649 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:21.398086 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:21.397752 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7ggw" podUID="dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4" Jul 15 22:34:22.397589 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:22.397550 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:22.397771 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:22.397654 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74kgh" podUID="a82af034-adb2-404d-af19-226f8702524e" Jul 15 22:34:22.397771 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:22.397682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:22.397771 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:22.397742 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlpr2" podUID="69fa51a1-f78c-4236-9de4-d35f40fb4ff5" Jul 15 22:34:23.281430 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.281402 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-147.ec2.internal" event="NodeReady" Jul 15 22:34:23.281628 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.281558 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 22:34:23.329081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.329000 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fpv6x" podStartSLOduration=23.500927987 podStartE2EDuration="55.328978636s" totalImagesPullingTime="31.828050649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:07.737271934 +0000 UTC m=+40.827923189" watchObservedRunningTime="2026-07-15 22:34:23.328978636 +0000 UTC m=+56.419629880" Jul 15 22:34:23.329475 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.329455 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-77fqf"] Jul 15 22:34:23.350710 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.350681 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nz28d"] Jul 15 22:34:23.351289 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.351265 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.353960 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.353935 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trnq4\"" Jul 15 22:34:23.354063 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.353974 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 22:34:23.354296 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.354278 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 22:34:23.370756 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.370729 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-77fqf"] Jul 15 22:34:23.370878 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.370764 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nz28d"] Jul 15 22:34:23.370966 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.370869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.374309 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.374289 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 22:34:23.374413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.374289 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 22:34:23.374413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.374292 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 22:34:23.374413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.374363 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkr96\"" Jul 15 22:34:23.374970 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.374945 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 22:34:23.398303 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.398277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:23.400654 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.400634 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:34:23.405713 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4ck\" (UniqueName: \"kubernetes.io/projected/2e50e605-1e35-45da-908b-30a50d18cb95-kube-api-access-2n4ck\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.405786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894cdc27-c852-468b-a9e8-76f609388a7d-metrics-tls\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.405786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894cdc27-c852-468b-a9e8-76f609388a7d-tmp-dir\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.405786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894cdc27-c852-468b-a9e8-76f609388a7d-config-volume\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.405918 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e50e605-1e35-45da-908b-30a50d18cb95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.405962 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e50e605-1e35-45da-908b-30a50d18cb95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.406000 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.405976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbcw\" (UniqueName: \"kubernetes.io/projected/894cdc27-c852-468b-a9e8-76f609388a7d-kube-api-access-wkbcw\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.406033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.406022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e50e605-1e35-45da-908b-30a50d18cb95-crio-socket\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.406064 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.406049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e50e605-1e35-45da-908b-30a50d18cb95-data-volume\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.432853 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.432821 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgs4"] Jul 15 22:34:23.454933 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.454885 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgs4"] Jul 15 22:34:23.455061 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.455005 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.457799 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.457779 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l8qc7\"" Jul 15 22:34:23.458494 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.457825 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 22:34:23.458494 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.457924 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 22:34:23.458494 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.458340 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 22:34:23.506883 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.506847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e50e605-1e35-45da-908b-30a50d18cb95-crio-socket\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.506883 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.506889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e50e605-1e35-45da-908b-30a50d18cb95-data-volume\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507122 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507019 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-cert\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.507122 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4ck\" (UniqueName: \"kubernetes.io/projected/2e50e605-1e35-45da-908b-30a50d18cb95-kube-api-access-2n4ck\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507122 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e50e605-1e35-45da-908b-30a50d18cb95-crio-socket\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894cdc27-c852-468b-a9e8-76f609388a7d-metrics-tls\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507153 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894cdc27-c852-468b-a9e8-76f609388a7d-tmp-dir\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894cdc27-c852-468b-a9e8-76f609388a7d-config-volume\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e50e605-1e35-45da-908b-30a50d18cb95-data-volume\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e50e605-1e35-45da-908b-30a50d18cb95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e50e605-1e35-45da-908b-30a50d18cb95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.507530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p2n\" (UniqueName: \"kubernetes.io/projected/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-kube-api-access-m6p2n\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.507530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507318 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbcw\" (UniqueName: \"kubernetes.io/projected/894cdc27-c852-468b-a9e8-76f609388a7d-kube-api-access-wkbcw\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.507530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507428 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894cdc27-c852-468b-a9e8-76f609388a7d-tmp-dir\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.507835 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.507813 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894cdc27-c852-468b-a9e8-76f609388a7d-config-volume\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.511082 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.511055 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894cdc27-c852-468b-a9e8-76f609388a7d-metrics-tls\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.515125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.515080 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e50e605-1e35-45da-908b-30a50d18cb95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.515239 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.515223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e50e605-1e35-45da-908b-30a50d18cb95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.517351 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.517325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbcw\" (UniqueName: \"kubernetes.io/projected/894cdc27-c852-468b-a9e8-76f609388a7d-kube-api-access-wkbcw\") pod \"dns-default-77fqf\" (UID: \"894cdc27-c852-468b-a9e8-76f609388a7d\") " pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.518372 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.518353 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4ck\" (UniqueName: \"kubernetes.io/projected/2e50e605-1e35-45da-908b-30a50d18cb95-kube-api-access-2n4ck\") pod \"insights-runtime-extractor-nz28d\" (UID: \"2e50e605-1e35-45da-908b-30a50d18cb95\") " pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.608684 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.608589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-cert\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.608684 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.608654 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2n\" (UniqueName: \"kubernetes.io/projected/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-kube-api-access-m6p2n\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.611281 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.611254 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-cert\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.620852 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.620827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p2n\" (UniqueName: \"kubernetes.io/projected/00ff2d6e-47b3-40f8-ad37-2691ca6165dd-kube-api-access-m6p2n\") pod \"ingress-canary-hmgs4\" (UID: \"00ff2d6e-47b3-40f8-ad37-2691ca6165dd\") " pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.660734 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.660695 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:23.681799 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.681781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nz28d" Jul 15 22:34:23.764137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.764096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmgs4" Jul 15 22:34:23.867406 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.867315 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-77fqf"] Jul 15 22:34:23.870823 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:23.870789 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894cdc27_c852_468b_a9e8_76f609388a7d.slice/crio-f1ea96a47a488eda355548ea2fde9abd7eda68840b166d460f0c36c40cc404e3 WatchSource:0}: Error finding container f1ea96a47a488eda355548ea2fde9abd7eda68840b166d460f0c36c40cc404e3: Status 404 returned error can't find the container with id f1ea96a47a488eda355548ea2fde9abd7eda68840b166d460f0c36c40cc404e3 Jul 15 22:34:23.882996 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.882968 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nz28d"] Jul 15 22:34:23.886718 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:23.886691 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e50e605_1e35_45da_908b_30a50d18cb95.slice/crio-b89d95f8cc0288d569153da00b518985bd87aae5bfe00b1699d0bbeb224497ae WatchSource:0}: Error finding container b89d95f8cc0288d569153da00b518985bd87aae5bfe00b1699d0bbeb224497ae: Status 404 returned error can't find the container with id b89d95f8cc0288d569153da00b518985bd87aae5bfe00b1699d0bbeb224497ae Jul 15 22:34:23.929321 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.929285 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgs4"] Jul 15 22:34:23.932410 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:23.932382 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ff2d6e_47b3_40f8_ad37_2691ca6165dd.slice/crio-1a31a540cef9b553c1f079006c7c554d0318fd0aaf7598679f0120e62feef4aa WatchSource:0}: Error finding container 1a31a540cef9b553c1f079006c7c554d0318fd0aaf7598679f0120e62feef4aa: Status 404 returned error can't find the container with id 1a31a540cef9b553c1f079006c7c554d0318fd0aaf7598679f0120e62feef4aa Jul 15 22:34:23.986623 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:23.986587 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg"] Jul 15 22:34:24.017249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.017213 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg"] Jul 15 22:34:24.017398 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.017313 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:24.019977 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.019950 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 22:34:24.020109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.020059 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pqc75\"" Jul 15 22:34:24.114311 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.114269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a78073b-2b86-4016-a65a-a085869aa9ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-skszg\" (UID: \"1a78073b-2b86-4016-a65a-a085869aa9ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:24.215694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.215658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a78073b-2b86-4016-a65a-a085869aa9ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-skszg\" (UID: \"1a78073b-2b86-4016-a65a-a085869aa9ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:24.218245 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.218225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1a78073b-2b86-4016-a65a-a085869aa9ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-skszg\" (UID: \"1a78073b-2b86-4016-a65a-a085869aa9ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:24.296544 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.296509 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-kv8vz"] Jul 15 22:34:24.298428 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.298271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:24.301050 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.301024 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 22:34:24.301050 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.301037 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 22:34:24.301621 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.301600 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8vdgp\"" Jul 15 22:34:24.314387 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.314307 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kv8vz"] Jul 15 22:34:24.316517 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.316483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6s4q\" (UniqueName: \"kubernetes.io/projected/6526eb58-99eb-403b-b5e2-f991e790892d-kube-api-access-g6s4q\") pod \"downloads-68c9cbb497-kv8vz\" (UID: \"6526eb58-99eb-403b-b5e2-f991e790892d\") " pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:24.327185 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.326826 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:24.399141 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.398251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:24.402938 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.400833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:24.403197 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.403091 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qmq28\"" Jul 15 22:34:24.403249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.403224 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:34:24.405037 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.405012 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 22:34:24.405324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.405307 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-84k7s\"" Jul 15 22:34:24.405582 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.405532 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 22:34:24.417098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.417051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6s4q\" (UniqueName: \"kubernetes.io/projected/6526eb58-99eb-403b-b5e2-f991e790892d-kube-api-access-g6s4q\") pod \"downloads-68c9cbb497-kv8vz\" (UID: \"6526eb58-99eb-403b-b5e2-f991e790892d\") " pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:24.431438 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.431388 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6s4q\" (UniqueName: \"kubernetes.io/projected/6526eb58-99eb-403b-b5e2-f991e790892d-kube-api-access-g6s4q\") pod \"downloads-68c9cbb497-kv8vz\" (UID: \"6526eb58-99eb-403b-b5e2-f991e790892d\") " pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:24.517603 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.517572 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg"] Jul 15 22:34:24.525463 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:24.525432 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a78073b_2b86_4016_a65a_a085869aa9ec.slice/crio-716a89b26987582406df08eeffd1b63a70d04374dafe174ff7527c7d425f12a7 WatchSource:0}: Error finding container 716a89b26987582406df08eeffd1b63a70d04374dafe174ff7527c7d425f12a7: Status 404 returned error can't find the container with id 716a89b26987582406df08eeffd1b63a70d04374dafe174ff7527c7d425f12a7 Jul 15 22:34:24.610965 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.610923 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:24.746918 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.746864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77fqf" event={"ID":"894cdc27-c852-468b-a9e8-76f609388a7d","Type":"ContainerStarted","Data":"f1ea96a47a488eda355548ea2fde9abd7eda68840b166d460f0c36c40cc404e3"} Jul 15 22:34:24.749813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.749773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmgs4" event={"ID":"00ff2d6e-47b3-40f8-ad37-2691ca6165dd","Type":"ContainerStarted","Data":"1a31a540cef9b553c1f079006c7c554d0318fd0aaf7598679f0120e62feef4aa"} Jul 15 22:34:24.754779 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.754737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz28d" event={"ID":"2e50e605-1e35-45da-908b-30a50d18cb95","Type":"ContainerStarted","Data":"b89d95f8cc0288d569153da00b518985bd87aae5bfe00b1699d0bbeb224497ae"} Jul 15 22:34:24.759472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.759436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" event={"ID":"1a78073b-2b86-4016-a65a-a085869aa9ec","Type":"ContainerStarted","Data":"716a89b26987582406df08eeffd1b63a70d04374dafe174ff7527c7d425f12a7"} Jul 15 22:34:24.805112 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:24.805073 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kv8vz"] Jul 15 22:34:24.811742 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:24.810267 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6526eb58_99eb_403b_b5e2_f991e790892d.slice/crio-776a9ed39faf732e1cf32e52ebf58f1d12b82cadaa3df66fac093898a47a22f0 WatchSource:0}: Error finding container 776a9ed39faf732e1cf32e52ebf58f1d12b82cadaa3df66fac093898a47a22f0: Status 404 returned error can't find the container with id 776a9ed39faf732e1cf32e52ebf58f1d12b82cadaa3df66fac093898a47a22f0 Jul 15 22:34:25.764117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:25.764072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kv8vz" event={"ID":"6526eb58-99eb-403b-b5e2-f991e790892d","Type":"ContainerStarted","Data":"776a9ed39faf732e1cf32e52ebf58f1d12b82cadaa3df66fac093898a47a22f0"} Jul 15 22:34:26.770259 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:26.770216 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77fqf" event={"ID":"894cdc27-c852-468b-a9e8-76f609388a7d","Type":"ContainerStarted","Data":"061e1ac79618e446837cf46a9978785861c72f2c00776384148a8f0f0393f65d"} Jul 15 22:34:26.770679 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:26.770279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77fqf" event={"ID":"894cdc27-c852-468b-a9e8-76f609388a7d","Type":"ContainerStarted","Data":"527e983de6c4c6c8f52caefa0f9b6fe3f8c846ef50be0b7caf968b77dae85946"} Jul 15 22:34:26.770981 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:26.770961 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:26.789435 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:26.788780 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-77fqf" podStartSLOduration=1.722297517 podStartE2EDuration="3.788760727s" totalImagesPullingTime="2.06646321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:26.787529777 +0000 UTC m=+59.878181031" watchObservedRunningTime="2026-07-15 22:34:26.788760727 +0000 UTC m=+59.879411972" Jul 15 22:34:29.695056 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:29.695021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcj56" Jul 15 22:34:31.786298 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.786198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmgs4" event={"ID":"00ff2d6e-47b3-40f8-ad37-2691ca6165dd","Type":"ContainerStarted","Data":"e36da22c24c8236d2616b4838d07f69de16169ac88d9be9e863fda8c8b55d90e"} Jul 15 22:34:31.788798 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.788441 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz28d" event={"ID":"2e50e605-1e35-45da-908b-30a50d18cb95","Type":"ContainerStarted","Data":"15765ef3a313eb224d13a34e11b57cbd054b2e2e2f72f58e544c1ad960042be7"} Jul 15 22:34:31.791293 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.791261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" event={"ID":"1a78073b-2b86-4016-a65a-a085869aa9ec","Type":"ContainerStarted","Data":"1a13ec87ccdfe420b4b64cf8bc6523fafbcf5a6adc645ca520c4294c999a0f47"} Jul 15 22:34:31.791957 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.791933 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:31.798074 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.798043 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" Jul 15 22:34:31.803493 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.803429 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hmgs4" podStartSLOduration=1.248099856 podStartE2EDuration="8.803411325s" totalImagesPullingTime="7.555311469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:31.802575501 +0000 UTC m=+64.893226746" watchObservedRunningTime="2026-07-15 22:34:31.803411325 +0000 UTC m=+64.894062627" Jul 15 22:34:31.821181 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:31.821103 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-skszg" podStartSLOduration=1.860424627 podStartE2EDuration="8.821078834s" totalImagesPullingTime="6.960654207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:31.820452692 +0000 UTC m=+64.911103935" watchObservedRunningTime="2026-07-15 22:34:31.821078834 +0000 UTC m=+64.911730078" Jul 15 22:34:32.066686 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.066592 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-l4xs6"] Jul 15 22:34:32.068785 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.068764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.071626 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.071601 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 22:34:32.072004 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.071981 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 22:34:32.072825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.072796 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 22:34:32.072958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.072856 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5qgrh\"" Jul 15 22:34:32.072958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.072887 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 22:34:32.072958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.072801 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 22:34:32.081844 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.081818 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-l4xs6"] Jul 15 22:34:32.085472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.085103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:32.087948 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.087922 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:34:32.099363 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.099328 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69fa51a1-f78c-4236-9de4-d35f40fb4ff5-metrics-certs\") pod \"network-metrics-daemon-dlpr2\" (UID: \"69fa51a1-f78c-4236-9de4-d35f40fb4ff5\") " pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:32.186570 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.186529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.186757 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.186588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxvf\" (UniqueName: \"kubernetes.io/projected/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-kube-api-access-5bxvf\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.186757 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.186621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.186757 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.186688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:32.186757 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.186732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.189592 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.189566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:34:32.199794 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.199767 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4-original-pull-secret\") pod \"global-pull-secret-syncer-q7ggw\" (UID: \"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4\") " pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:32.226945 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.226894 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qmq28\"" Jul 15 22:34:32.234951 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.234914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlpr2" Jul 15 22:34:32.287778 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.287740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:32.287972 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.287789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.287972 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.287823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxvf\" (UniqueName: \"kubernetes.io/projected/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-kube-api-access-5bxvf\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.287972 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.287852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.287972 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.287887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.288177 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:32.288034 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 22:34:32.288177 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:32.288096 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls podName:69fcfd51-fc64-4d66-89cb-1e7c68938c1c nodeName:}" failed. No retries permitted until 2026-07-15 22:34:32.78807704 +0000 UTC m=+65.878728282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls") pod "prometheus-operator-64785b6675-l4xs6" (UID: "69fcfd51-fc64-4d66-89cb-1e7c68938c1c") : secret "prometheus-operator-tls" not found Jul 15 22:34:32.289002 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.288978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.290869 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.290842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.293993 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.293967 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 22:34:32.300647 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.300620 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 22:34:32.302124 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.301884 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxvf\" (UniqueName: \"kubernetes.io/projected/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-kube-api-access-5bxvf\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.312589 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.312559 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhld\" (UniqueName: \"kubernetes.io/projected/a82af034-adb2-404d-af19-226f8702524e-kube-api-access-clhld\") pod \"network-check-target-74kgh\" (UID: \"a82af034-adb2-404d-af19-226f8702524e\") " pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:32.393659 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.393628 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dlpr2"] Jul 15 22:34:32.399594 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:32.399567 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fa51a1_f78c_4236_9de4_d35f40fb4ff5.slice/crio-1704df6a9676583729e3af8476df90de129c83f7ee20b6d56d274301e7e970ba WatchSource:0}: Error finding container 1704df6a9676583729e3af8476df90de129c83f7ee20b6d56d274301e7e970ba: Status 404 returned error can't find the container with id 1704df6a9676583729e3af8476df90de129c83f7ee20b6d56d274301e7e970ba Jul 15 22:34:32.406370 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.406344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7ggw" Jul 15 22:34:32.533326 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.533289 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-84k7s\"" Jul 15 22:34:32.541144 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.541111 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:32.565573 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.565502 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7ggw"] Jul 15 22:34:32.693846 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.692836 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74kgh"] Jul 15 22:34:32.696725 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:32.696697 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82af034_adb2_404d_af19_226f8702524e.slice/crio-7cda73755e95332a1fcf3f0dec654aa7bace3bef5f8c96392d92e9bcfcd0de8b WatchSource:0}: Error finding container 7cda73755e95332a1fcf3f0dec654aa7bace3bef5f8c96392d92e9bcfcd0de8b: Status 404 returned error can't find the container with id 7cda73755e95332a1fcf3f0dec654aa7bace3bef5f8c96392d92e9bcfcd0de8b Jul 15 22:34:32.791659 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.791616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.794330 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.794304 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fcfd51-fc64-4d66-89cb-1e7c68938c1c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-l4xs6\" (UID: \"69fcfd51-fc64-4d66-89cb-1e7c68938c1c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:32.795194 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.795167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74kgh" event={"ID":"a82af034-adb2-404d-af19-226f8702524e","Type":"ContainerStarted","Data":"7cda73755e95332a1fcf3f0dec654aa7bace3bef5f8c96392d92e9bcfcd0de8b"} Jul 15 22:34:32.796146 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.796126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7ggw" event={"ID":"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4","Type":"ContainerStarted","Data":"640ce45861862676221f2efed0db677f1d2aeae918a06965f0d35bffaeadb40b"} Jul 15 22:34:32.797066 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.797047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlpr2" event={"ID":"69fa51a1-f78c-4236-9de4-d35f40fb4ff5","Type":"ContainerStarted","Data":"1704df6a9676583729e3af8476df90de129c83f7ee20b6d56d274301e7e970ba"} Jul 15 22:34:32.980100 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:32.980054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" Jul 15 22:34:33.163392 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.163312 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-l4xs6"] Jul 15 22:34:33.170114 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:33.170078 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fcfd51_fc64_4d66_89cb_1e7c68938c1c.slice/crio-2ac2ec37a90980692a8997dcc4a2a0964011ce99b5137779b8ca23217cff3be6 WatchSource:0}: Error finding container 2ac2ec37a90980692a8997dcc4a2a0964011ce99b5137779b8ca23217cff3be6: Status 404 returned error can't find the container with id 2ac2ec37a90980692a8997dcc4a2a0964011ce99b5137779b8ca23217cff3be6 Jul 15 22:34:33.472291 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.471256 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:34:33.475417 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.474095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.480377 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.480221 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 22:34:33.480377 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.480281 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 22:34:33.481643 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.481244 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 22:34:33.481643 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.481357 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zxb9h\"" Jul 15 22:34:33.481643 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.481483 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 22:34:33.481643 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.481554 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 22:34:33.488876 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.488853 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:34:33.599108 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.599299 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.599299 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.599299 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.599299 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.599299 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.599248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700396 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.700567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.700557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.701333 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.701307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.701759 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.701734 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.702353 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.702327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.705199 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.705172 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.707380 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.707336 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.710855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.710814 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj\") pod \"console-64f5b68d9b-65btn\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.790551 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.790245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:33.808786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:33.808705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" event={"ID":"69fcfd51-fc64-4d66-89cb-1e7c68938c1c","Type":"ContainerStarted","Data":"2ac2ec37a90980692a8997dcc4a2a0964011ce99b5137779b8ca23217cff3be6"} Jul 15 22:34:34.003522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:34.003375 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:34:34.010459 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:34.010416 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7849f1c9_56b7_4fef_82c4_b37a7003e711.slice/crio-3237c30311212641384384410b24d50bd8372529ebf45812c3a71d1a44dc7cea WatchSource:0}: Error finding container 3237c30311212641384384410b24d50bd8372529ebf45812c3a71d1a44dc7cea: Status 404 returned error can't find the container with id 3237c30311212641384384410b24d50bd8372529ebf45812c3a71d1a44dc7cea Jul 15 22:34:34.818207 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:34.817608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlpr2" event={"ID":"69fa51a1-f78c-4236-9de4-d35f40fb4ff5","Type":"ContainerStarted","Data":"db4415f9bce657a74424a4b6dd75fc8f1c43ddebb99cf4c4330bf1c5d8bba486"} Jul 15 22:34:34.818207 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:34.817715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlpr2" event={"ID":"69fa51a1-f78c-4236-9de4-d35f40fb4ff5","Type":"ContainerStarted","Data":"4741de61864a643e95be9e5137e8d198677316082a6ecbdc5e05fc8257c774b6"} Jul 15 22:34:34.819613 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:34.819580 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5b68d9b-65btn" event={"ID":"7849f1c9-56b7-4fef-82c4-b37a7003e711","Type":"ContainerStarted","Data":"3237c30311212641384384410b24d50bd8372529ebf45812c3a71d1a44dc7cea"} Jul 15 22:34:37.778601 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:37.778572 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-77fqf" Jul 15 22:34:37.796847 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:37.796796 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dlpr2" podStartSLOduration=68.535659574 podStartE2EDuration="1m9.796779577s" totalImagesPullingTime="1.261120003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:34.839886362 +0000 UTC m=+67.930537605" watchObservedRunningTime="2026-07-15 22:34:37.796779577 +0000 UTC m=+70.887430821" Jul 15 22:34:43.029403 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.029368 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:34:43.035082 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.035046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.044948 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.044922 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 22:34:43.052512 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.052484 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:34:43.178873 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.178831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179073 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.178878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179073 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.178928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179073 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.179001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslkr\" (UniqueName: \"kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179073 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.179061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179264 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.179094 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.179264 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.179123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.279831 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.279831 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.279831 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslkr\" (UniqueName: \"kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.279918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280295 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.280264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280619 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.280595 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280760 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.280733 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.280957 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.280886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.281063 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.281005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.282634 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.282614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.283250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.283223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.290943 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.290893 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslkr\" (UniqueName: \"kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr\") pod \"console-6d7468d9bf-j9t7v\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:43.347677 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:43.347623 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:49.541759 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.541728 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:34:49.593303 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:49.593266 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fcb162_46c9_41bf_b3dc_ac453366a337.slice/crio-ef1454b0f8b7f0fbe4951de11adf43a1dcc23487339b5f980df3b0f15afb7ed7 WatchSource:0}: Error finding container ef1454b0f8b7f0fbe4951de11adf43a1dcc23487339b5f980df3b0f15afb7ed7: Status 404 returned error can't find the container with id ef1454b0f8b7f0fbe4951de11adf43a1dcc23487339b5f980df3b0f15afb7ed7 Jul 15 22:34:49.883273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.883169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5b68d9b-65btn" event={"ID":"7849f1c9-56b7-4fef-82c4-b37a7003e711","Type":"ContainerStarted","Data":"805b95f841b0efccb6d9c978f27507deb35eeb1cd58ccf8172665f6faa0b76c9"} Jul 15 22:34:49.885226 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.885190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7468d9bf-j9t7v" event={"ID":"49fcb162-46c9-41bf-b3dc-ac453366a337","Type":"ContainerStarted","Data":"e052e2c7f6b5804dce132ecafa798e546674b8081e9746676f0c55d78964e599"} Jul 15 22:34:49.885360 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.885252 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7468d9bf-j9t7v" event={"ID":"49fcb162-46c9-41bf-b3dc-ac453366a337","Type":"ContainerStarted","Data":"ef1454b0f8b7f0fbe4951de11adf43a1dcc23487339b5f980df3b0f15afb7ed7"} Jul 15 22:34:49.887607 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.887575 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz28d" event={"ID":"2e50e605-1e35-45da-908b-30a50d18cb95","Type":"ContainerStarted","Data":"37f538d111d458a77bd67d764a94ae6bd027dc4144c0ebc1a906c3cb62bba4eb"} Jul 15 22:34:49.889210 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.889181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74kgh" event={"ID":"a82af034-adb2-404d-af19-226f8702524e","Type":"ContainerStarted","Data":"55254d26ded463731311a8503f975e14ac4cb80c1362d3f1cc8507851c827187"} Jul 15 22:34:49.889338 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.889260 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:34:49.890960 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.890932 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7ggw" event={"ID":"dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4","Type":"ContainerStarted","Data":"5536e558725876690570af657435448a60654d56707acbfcb3d031b678f670a8"} Jul 15 22:34:49.893009 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.892987 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" event={"ID":"69fcfd51-fc64-4d66-89cb-1e7c68938c1c","Type":"ContainerStarted","Data":"ac3c114b4adb27e3dc33fc0d4c2c48fe033e18954bcf16c2954c733d82092531"} Jul 15 22:34:49.893112 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.893043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" event={"ID":"69fcfd51-fc64-4d66-89cb-1e7c68938c1c","Type":"ContainerStarted","Data":"422ca0dcce8861e427dabda38fd6230ed4c4d9ed5810047e702ab2553b0a5bb6"} Jul 15 22:34:49.894715 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.894693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kv8vz" event={"ID":"6526eb58-99eb-403b-b5e2-f991e790892d","Type":"ContainerStarted","Data":"945c83bcd828eeed55268f1b41ad99b4502c0f63783875f088d906a8909fc68e"} Jul 15 22:34:49.895117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.895098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:49.908694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.908656 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-kv8vz" Jul 15 22:34:49.914327 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.914266 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64f5b68d9b-65btn" podStartSLOduration=1.5696003429999998 podStartE2EDuration="16.91424859s" totalImagesPullingTime="15.344648247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:49.913978749 +0000 UTC m=+83.004629994" watchObservedRunningTime="2026-07-15 22:34:49.91424859 +0000 UTC m=+83.004899811" Jul 15 22:34:49.953019 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:49.952956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-74kgh" podStartSLOduration=65.29346188 podStartE2EDuration="1m21.952933816s" totalImagesPullingTime="16.659471936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:49.951393645 +0000 UTC m=+83.042044889" watchObservedRunningTime="2026-07-15 22:34:49.952933816 +0000 UTC m=+83.043585062" Jul 15 22:34:50.016808 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:50.016741 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q7ggw" podStartSLOduration=65.23087361 podStartE2EDuration="1m22.016719192s" totalImagesPullingTime="16.785845582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:49.976742805 +0000 UTC m=+83.067394058" watchObservedRunningTime="2026-07-15 22:34:50.016719192 +0000 UTC m=+83.107370432" Jul 15 22:34:50.064098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:50.064037 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-kv8vz" podStartSLOduration=1.51838805 podStartE2EDuration="26.064015628s" totalImagesPullingTime="24.545627578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:50.062520277 +0000 UTC m=+83.153171520" watchObservedRunningTime="2026-07-15 22:34:50.064015628 +0000 UTC m=+83.154666872" Jul 15 22:34:50.064298 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:50.064208 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7468d9bf-j9t7v" podStartSLOduration=7.064199051 podStartE2EDuration="7.064199051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:50.018246143 +0000 UTC m=+83.108897389" watchObservedRunningTime="2026-07-15 22:34:50.064199051 +0000 UTC m=+83.154850295" Jul 15 22:34:50.101722 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:50.101660 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-l4xs6" podStartSLOduration=1.919842584 podStartE2EDuration="18.101637674s" totalImagesPullingTime="16.18179509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:50.100772726 +0000 UTC m=+83.191423970" watchObservedRunningTime="2026-07-15 22:34:50.101637674 +0000 UTC m=+83.192288918" Jul 15 22:34:52.979007 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:52.978300 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c"] Jul 15 22:34:53.086943 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.086465 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c"] Jul 15 22:34:53.086943 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.086541 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tfs7w"] Jul 15 22:34:53.086943 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.086636 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.091565 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.091513 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pjkg5\"" Jul 15 22:34:53.091834 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.091813 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 22:34:53.094737 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.094368 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 22:34:53.123830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.123792 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kqsz5"] Jul 15 22:34:53.124068 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.123947 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.128710 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.128682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jd4zh\"" Jul 15 22:34:53.129241 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.129127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 22:34:53.129438 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.129421 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 22:34:53.131694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.131394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 22:34:53.150159 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.150121 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tfs7w"] Jul 15 22:34:53.150380 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.150286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.156524 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.156495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 22:34:53.156937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.156883 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 22:34:53.157541 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.157521 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 22:34:53.158218 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.158188 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6k2f\"" Jul 15 22:34:53.166109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.165884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6kjp\" (UniqueName: \"kubernetes.io/projected/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-kube-api-access-p6kjp\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.166109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.165948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.166109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.165978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.166109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.166045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.266958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.266839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-tls\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.266958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.266888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.266961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.266988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85wj7\" (UniqueName: \"kubernetes.io/projected/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-api-access-85wj7\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-sys\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.267324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267310 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6kjp\" (UniqueName: \"kubernetes.io/projected/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-kube-api-access-p6kjp\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-metrics-client-ca\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdp8\" (UniqueName: \"kubernetes.io/projected/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-kube-api-access-8jdp8\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-root\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-textfile\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c499bf3-fd2e-4c84-9036-58078ad9e96b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267865 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.267941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-wtmp\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.268642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.268430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.270743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.270720 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.271616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.271592 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.336096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.336060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6kjp\" (UniqueName: \"kubernetes.io/projected/ccb3a6f7-7ee4-4a01-94d6-028889fcdf12-kube-api-access-p6kjp\") pod \"openshift-state-metrics-84bd68b896-2m45c\" (UID: \"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.347703 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.347650 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:53.348741 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.348708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:53.355882 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.355850 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:53.369306 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.369306 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-metrics-client-ca\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdp8\" (UniqueName: \"kubernetes.io/projected/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-kube-api-access-8jdp8\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-root\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-textfile\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c499bf3-fd2e-4c84-9036-58078ad9e96b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369521 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-wtmp\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-tls\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.369593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.370071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.370071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85wj7\" (UniqueName: \"kubernetes.io/projected/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-api-access-85wj7\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.370071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.370071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-sys\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.370071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.369804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-sys\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.370763 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-root\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.370888 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-wtmp\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.371126 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.371370 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-metrics-client-ca\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.371671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c499bf3-fd2e-4c84-9036-58078ad9e96b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.371746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.371689 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c499bf3-fd2e-4c84-9036-58078ad9e96b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.372203 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.371837 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-textfile\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.372738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.372712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.374194 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.374149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.374740 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.374717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.374884 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.374856 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.376970 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.376921 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-node-exporter-tls\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.388155 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.388110 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdp8\" (UniqueName: \"kubernetes.io/projected/c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5-kube-api-access-8jdp8\") pod \"node-exporter-kqsz5\" (UID: \"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5\") " pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.403684 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.403651 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" Jul 15 22:34:53.404605 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.404545 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85wj7\" (UniqueName: \"kubernetes.io/projected/0c499bf3-fd2e-4c84-9036-58078ad9e96b-kube-api-access-85wj7\") pod \"kube-state-metrics-785778ff74-tfs7w\" (UID: \"0c499bf3-fd2e-4c84-9036-58078ad9e96b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.439445 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.439353 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" Jul 15 22:34:53.466845 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.466769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kqsz5" Jul 15 22:34:53.793070 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.793029 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:53.793251 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.793097 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:53.811020 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.810984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:53.920589 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.920556 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:34:53.920972 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:53.920947 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:34:54.129872 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.129780 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:34:54.165611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.165559 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:34:54.189244 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.188298 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.192185 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192151 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 22:34:54.192185 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192173 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 22:34:54.192403 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192229 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 22:34:54.192463 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192410 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 22:34:54.192463 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192446 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2sslt\"" Jul 15 22:34:54.192548 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192487 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 22:34:54.192624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192172 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 22:34:54.192922 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192873 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 22:34:54.193020 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 22:34:54.193020 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.192997 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 22:34:54.229865 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.229830 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:34:54.245708 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:54.245667 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c3e8da_9bf6_4a1b_be09_266a57d8b7c5.slice/crio-736a585590a3e46e2a2371821966f5b988492b25f31c54fb8425fbd0c90122c7 WatchSource:0}: Error finding container 736a585590a3e46e2a2371821966f5b988492b25f31c54fb8425fbd0c90122c7: Status 404 returned error can't find the container with id 736a585590a3e46e2a2371821966f5b988492b25f31c54fb8425fbd0c90122c7 Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbm7\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.288788 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.288711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.389870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.389870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.389995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbm7\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.390598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.390247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.391339 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.391243 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.392730 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.392669 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.394830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.394790 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.399558 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.399503 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.400087 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.400041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.401117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.400276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.401117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.400492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.401117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.400983 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.401490 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.401424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.401490 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.401485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.402593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.402539 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.402593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.402554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.414725 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.414647 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbm7\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7\") pod \"alertmanager-main-0\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.438432 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.438355 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c"] Jul 15 22:34:54.443073 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:54.443032 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb3a6f7_7ee4_4a01_94d6_028889fcdf12.slice/crio-4b5781db63bef11984189f118e897dd3a2b66157b81a2596c0a3ed7396448426 WatchSource:0}: Error finding container 4b5781db63bef11984189f118e897dd3a2b66157b81a2596c0a3ed7396448426: Status 404 returned error can't find the container with id 4b5781db63bef11984189f118e897dd3a2b66157b81a2596c0a3ed7396448426 Jul 15 22:34:54.468552 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.468510 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tfs7w"] Jul 15 22:34:54.501917 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.501874 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:34:54.925563 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.925131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" event={"ID":"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12","Type":"ContainerStarted","Data":"a2b1fd110fcd09c3cb70deb66d794cce677ceabad25f6b76c69aff626bed17d3"} Jul 15 22:34:54.925563 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.925462 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" event={"ID":"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12","Type":"ContainerStarted","Data":"4d54b848cfdfbb352f11a0927aaad517451c1ba904ba507257b91adcf9412875"} Jul 15 22:34:54.925563 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.925503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" event={"ID":"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12","Type":"ContainerStarted","Data":"4b5781db63bef11984189f118e897dd3a2b66157b81a2596c0a3ed7396448426"} Jul 15 22:34:54.926698 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.926605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" event={"ID":"0c499bf3-fd2e-4c84-9036-58078ad9e96b","Type":"ContainerStarted","Data":"d9798049cce4c0380197dd2a4e0d3cb88071889abd66b2f5f9247bdb1cff228b"} Jul 15 22:34:54.928666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.928637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqsz5" event={"ID":"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5","Type":"ContainerStarted","Data":"736a585590a3e46e2a2371821966f5b988492b25f31c54fb8425fbd0c90122c7"} Jul 15 22:34:54.936532 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.936502 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz28d" event={"ID":"2e50e605-1e35-45da-908b-30a50d18cb95","Type":"ContainerStarted","Data":"3fea20e8add54096185fa2284a49aec53342c7bfda4940b44eb24a463d1bef5b"} Jul 15 22:34:54.991418 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.991351 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nz28d" podStartSLOduration=1.294211059 podStartE2EDuration="31.991326061s" totalImagesPullingTime="30.697115002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:34:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:54.987192236 +0000 UTC m=+88.077843479" watchObservedRunningTime="2026-07-15 22:34:54.991326061 +0000 UTC m=+88.081977311" Jul 15 22:34:54.994545 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:54.994516 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:34:55.000138 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:55.000102 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b891c57_cb8e_479b_b6b6_5c17579e2db4.slice/crio-8579404d444ab8b133141abcbb120aba6e59bd6f30f4bc95a04aa7eadc2f075a WatchSource:0}: Error finding container 8579404d444ab8b133141abcbb120aba6e59bd6f30f4bc95a04aa7eadc2f075a: Status 404 returned error can't find the container with id 8579404d444ab8b133141abcbb120aba6e59bd6f30f4bc95a04aa7eadc2f075a Jul 15 22:34:55.954642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:55.954595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"8579404d444ab8b133141abcbb120aba6e59bd6f30f4bc95a04aa7eadc2f075a"} Jul 15 22:34:56.008594 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.008549 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59689dcdb7-4gpjh"] Jul 15 22:34:56.023877 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.023833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.043747 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.040852 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59689dcdb7-4gpjh"] Jul 15 22:34:56.043747 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.041249 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 22:34:56.043747 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.041518 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5rfgbts829dfd\"" Jul 15 22:34:56.043747 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.042487 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 22:34:56.043747 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.042793 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 22:34:56.053855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.053134 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 22:34:56.053855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.053440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 22:34:56.053855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.053688 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hpxtn\"" Jul 15 22:34:56.110427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.109683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjn8w\" (UniqueName: \"kubernetes.io/projected/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-kube-api-access-sjn8w\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.110427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.109771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-grpc-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.110427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.109805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.110427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.109848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.110427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.109884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.111189 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.111154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.111333 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.111223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.111333 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.111254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-metrics-client-ca\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjn8w\" (UniqueName: \"kubernetes.io/projected/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-kube-api-access-sjn8w\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-grpc-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.212979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.213043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.214273 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.213071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-metrics-client-ca\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.218057 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.217484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-metrics-client-ca\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.223499 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.223441 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.225160 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.225111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.230027 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.229976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.230685 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.230644 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.231722 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.231672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.233165 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.233137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjn8w\" (UniqueName: \"kubernetes.io/projected/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-kube-api-access-sjn8w\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.235446 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.235396 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4292db1-557d-4c0f-a001-ac5d1e8f5ae5-secret-grpc-tls\") pod \"thanos-querier-59689dcdb7-4gpjh\" (UID: \"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5\") " pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:56.354951 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:56.354884 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:34:57.310169 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.310131 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:34:57.332621 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.332590 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c"] Jul 15 22:34:57.332801 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.332740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.351029 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.350951 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:34:57.351029 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.350999 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c"] Jul 15 22:34:57.351029 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.351016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.354420 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.354392 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 22:34:57.355155 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.355128 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d8dw8\"" Jul 15 22:34:57.425230 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klnk\" (UniqueName: \"kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425230 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425503 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425503 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425503 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425503 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.425503 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.425411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.525888 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.525842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.525921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.525952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.525980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5klnk\" (UniqueName: \"kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.526384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.526384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dppp\" (UniqueName: \"kubernetes.io/projected/96744e76-2b4f-44ea-bbbb-f1113313616a-kube-api-access-4dppp\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.526993 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.526968 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.527818 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.527782 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.528956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.528926 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.529850 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.529800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.532069 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.532042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.540637 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.540571 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klnk\" (UniqueName: \"kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.548786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.548751 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert\") pod \"console-59c4594d4d-hjdsz\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.627200 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.627113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.627200 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.627177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dppp\" (UniqueName: \"kubernetes.io/projected/96744e76-2b4f-44ea-bbbb-f1113313616a-kube-api-access-4dppp\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.627462 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:57.627270 2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 22:34:57.627462 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:34:57.627339 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert podName:96744e76-2b4f-44ea-bbbb-f1113313616a nodeName:}" failed. No retries permitted until 2026-07-15 22:34:58.127317732 +0000 UTC m=+91.217968956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-b9g7c" (UID: "96744e76-2b4f-44ea-bbbb-f1113313616a") : secret "monitoring-plugin-cert" not found Jul 15 22:34:57.643985 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.643948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dppp\" (UniqueName: \"kubernetes.io/projected/96744e76-2b4f-44ea-bbbb-f1113313616a-kube-api-access-4dppp\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:57.651730 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.651694 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:34:57.873631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.873591 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5878db4587-d7h5w"] Jul 15 22:34:57.890335 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.890181 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:57.893528 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.893504 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-et763ki1vp40i\"" Jul 15 22:34:57.893863 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.893843 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 22:34:57.902684 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.902655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 22:34:57.902825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.902656 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 22:34:57.902825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.902799 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2l2qr\"" Jul 15 22:34:57.904874 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.904856 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 22:34:57.916143 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:57.916108 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5878db4587-d7h5w"] Jul 15 22:34:58.031363 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgvf\" (UniqueName: \"kubernetes.io/projected/845c202b-391b-402a-9dcb-340e38265a6b-kube-api-access-lpgvf\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031573 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031573 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-client-certs\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031573 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-tls\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031573 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/845c202b-391b-402a-9dcb-340e38265a6b-audit-log\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031752 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-metrics-server-audit-profiles\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.031752 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.031681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-client-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-client-certs\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-tls\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/845c202b-391b-402a-9dcb-340e38265a6b-audit-log\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-metrics-server-audit-profiles\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-client-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.133508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgvf\" (UniqueName: \"kubernetes.io/projected/845c202b-391b-402a-9dcb-340e38265a6b-kube-api-access-lpgvf\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.137599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.134581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.138362 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.138300 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/845c202b-391b-402a-9dcb-340e38265a6b-metrics-server-audit-profiles\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.139004 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.138671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/845c202b-391b-402a-9dcb-340e38265a6b-audit-log\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.139004 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.138960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-client-certs\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.140694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.140634 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-client-ca-bundle\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.140808 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.140751 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/845c202b-391b-402a-9dcb-340e38265a6b-secret-metrics-server-tls\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.141092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.141069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96744e76-2b4f-44ea-bbbb-f1113313616a-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-b9g7c\" (UID: \"96744e76-2b4f-44ea-bbbb-f1113313616a\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:58.146767 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.146713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgvf\" (UniqueName: \"kubernetes.io/projected/845c202b-391b-402a-9dcb-340e38265a6b-kube-api-access-lpgvf\") pod \"metrics-server-5878db4587-d7h5w\" (UID: \"845c202b-391b-402a-9dcb-340e38265a6b\") " pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.203141 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.203067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:34:58.269894 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.265893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:34:58.296790 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.296179 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-95d85497f-txdgg"] Jul 15 22:34:58.331992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.331408 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-95d85497f-txdgg"] Jul 15 22:34:58.331992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.331576 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.343705 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.342574 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 22:34:58.343705 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.343266 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 22:34:58.358123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.344679 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 22:34:58.358123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.344875 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l7n6z\"" Jul 15 22:34:58.358123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.345540 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 22:34:58.362842 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.362795 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 22:34:58.385225 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.385010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 22:34:58.388183 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.388041 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:34:58.409871 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.401225 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59689dcdb7-4gpjh"] Jul 15 22:34:58.442373 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:58.442335 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4292db1_557d_4c0f_a001_ac5d1e8f5ae5.slice/crio-d976d6d688bbfce04e109ab9886da32821f744900bfbaa2590bcd69682140d49 WatchSource:0}: Error finding container d976d6d688bbfce04e109ab9886da32821f744900bfbaa2590bcd69682140d49: Status 404 returned error can't find the container with id d976d6d688bbfce04e109ab9886da32821f744900bfbaa2590bcd69682140d49 Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447043 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-serving-certs-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-federate-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-metrics-client-ca\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mw6g\" (UniqueName: \"kubernetes.io/projected/70299c0b-af28-46bb-90cb-765b24d8321c-kube-api-access-8mw6g\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.450261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.447347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.510038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.510011 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5878db4587-d7h5w"] Jul 15 22:34:58.536459 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:58.529750 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845c202b_391b_402a_9dcb_340e38265a6b.slice/crio-2e4f642eeb8790c7237a84d0b92540f32a968dfe9cf1d303a54cfb991b9488ab WatchSource:0}: Error finding container 2e4f642eeb8790c7237a84d0b92540f32a968dfe9cf1d303a54cfb991b9488ab: Status 404 returned error can't find the container with id 2e4f642eeb8790c7237a84d0b92540f32a968dfe9cf1d303a54cfb991b9488ab Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-serving-certs-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-federate-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-metrics-client-ca\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560364 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mw6g\" (UniqueName: \"kubernetes.io/projected/70299c0b-af28-46bb-90cb-765b24d8321c-kube-api-access-8mw6g\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.560932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-serving-certs-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.561743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.561686 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.562412 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.561998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70299c0b-af28-46bb-90cb-765b24d8321c-metrics-client-ca\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.566196 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.566103 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.566541 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.566487 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-telemeter-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.575948 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.574845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-federate-client-tls\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.579678 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.579632 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mw6g\" (UniqueName: \"kubernetes.io/projected/70299c0b-af28-46bb-90cb-765b24d8321c-kube-api-access-8mw6g\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.586182 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.586088 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70299c0b-af28-46bb-90cb-765b24d8321c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-95d85497f-txdgg\" (UID: \"70299c0b-af28-46bb-90cb-765b24d8321c\") " pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.590956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.590673 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c"] Jul 15 22:34:58.694663 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.694631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" Jul 15 22:34:58.902587 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.902552 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-95d85497f-txdgg"] Jul 15 22:34:58.905301 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:34:58.905275 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70299c0b_af28_46bb_90cb_765b24d8321c.slice/crio-19fe049bbd58398ba1e5e7ab473cbceaeb63948f80aae12ee07dff654a5d7788 WatchSource:0}: Error finding container 19fe049bbd58398ba1e5e7ab473cbceaeb63948f80aae12ee07dff654a5d7788: Status 404 returned error can't find the container with id 19fe049bbd58398ba1e5e7ab473cbceaeb63948f80aae12ee07dff654a5d7788 Jul 15 22:34:58.970564 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.970483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" event={"ID":"ccb3a6f7-7ee4-4a01-94d6-028889fcdf12","Type":"ContainerStarted","Data":"dc105dc862b3d9507f2a4884c5471c551594e509e22155cf07be455557f30aec"} Jul 15 22:34:58.973666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.973056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" event={"ID":"0c499bf3-fd2e-4c84-9036-58078ad9e96b","Type":"ContainerStarted","Data":"2b2be3c1b542b0c4f861d9d2cd81987f1c1912351365c04f2b6a90edd4f20369"} Jul 15 22:34:58.973666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.973129 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" event={"ID":"0c499bf3-fd2e-4c84-9036-58078ad9e96b","Type":"ContainerStarted","Data":"759e79eecb9be4e50b79706cf581b95af05ea03e9329764620eb958ffac1a028"} Jul 15 22:34:58.973666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.973158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" event={"ID":"0c499bf3-fd2e-4c84-9036-58078ad9e96b","Type":"ContainerStarted","Data":"da9e869ade4197cb975412cd7a1d61d4cdf343e09f8e0726f46886e7837dbfce"} Jul 15 22:34:58.974451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.974418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" event={"ID":"96744e76-2b4f-44ea-bbbb-f1113313616a","Type":"ContainerStarted","Data":"dc603cbd02062b40f69d77799f578fdd16454e2f909c8a0087aa9ae54e98d7fa"} Jul 15 22:34:58.976276 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.976251 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc" exitCode=0 Jul 15 22:34:58.976395 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.976341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc"} Jul 15 22:34:58.978915 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.978867 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4594d4d-hjdsz" event={"ID":"9a4d9076-7570-47a5-b24f-f98692f0748f","Type":"ContainerStarted","Data":"b3353d85898550039c7a9af6d34a57df3b6bc26b02a30afd90ee5aff91b48e07"} Jul 15 22:34:58.979010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.978942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4594d4d-hjdsz" event={"ID":"9a4d9076-7570-47a5-b24f-f98692f0748f","Type":"ContainerStarted","Data":"65e50656164e44934a1d154b79540b715c02042c407be088b9cab4c563a539d2"} Jul 15 22:34:58.980615 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.980576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" event={"ID":"845c202b-391b-402a-9dcb-340e38265a6b","Type":"ContainerStarted","Data":"2e4f642eeb8790c7237a84d0b92540f32a968dfe9cf1d303a54cfb991b9488ab"} Jul 15 22:34:58.982403 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.982375 2556 generic.go:356] "Generic (PLEG): container finished" podID="c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5" containerID="aa76a530f8617c5f8ae0f169e50369c698c0435df3b4129d19be0318364ecdca" exitCode=0 Jul 15 22:34:58.982549 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.982467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqsz5" event={"ID":"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5","Type":"ContainerDied","Data":"aa76a530f8617c5f8ae0f169e50369c698c0435df3b4129d19be0318364ecdca"} Jul 15 22:34:58.985313 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.985293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" event={"ID":"70299c0b-af28-46bb-90cb-765b24d8321c","Type":"ContainerStarted","Data":"19fe049bbd58398ba1e5e7ab473cbceaeb63948f80aae12ee07dff654a5d7788"} Jul 15 22:34:58.987141 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:58.987054 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"d976d6d688bbfce04e109ab9886da32821f744900bfbaa2590bcd69682140d49"} Jul 15 22:34:59.004731 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.004679 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2m45c" podStartSLOduration=3.802695292 podStartE2EDuration="7.004659236s" totalImagesPullingTime="3.201963944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:59.002843616 +0000 UTC m=+92.093494859" watchObservedRunningTime="2026-07-15 22:34:59.004659236 +0000 UTC m=+92.095310479" Jul 15 22:34:59.044342 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.043219 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-tfs7w" podStartSLOduration=2.418536604 podStartE2EDuration="6.043197596s" totalImagesPullingTime="3.624660992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:59.041627888 +0000 UTC m=+92.132279131" watchObservedRunningTime="2026-07-15 22:34:59.043197596 +0000 UTC m=+92.133848842" Jul 15 22:34:59.114635 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.113827 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c4594d4d-hjdsz" podStartSLOduration=2.11380579 podStartE2EDuration="2.11380579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:34:59.111948671 +0000 UTC m=+92.202599913" watchObservedRunningTime="2026-07-15 22:34:59.11380579 +0000 UTC m=+92.204457033" Jul 15 22:34:59.523251 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.520834 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:34:59.535139 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.534041 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.540453 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.539601 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 22:34:59.540453 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.539846 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 22:34:59.540453 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.540085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 22:34:59.540453 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.540260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kw966\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.543362 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.543638 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.543937 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.544202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.544392 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.545616 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 22:34:59.550937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.545803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 22:34:59.553547 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.551767 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 22:34:59.553547 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.552004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 22:34:59.553547 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.552326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-k426cbqmtarj\"" Jul 15 22:34:59.554849 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.554792 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 22:34:59.558477 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.558449 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 22:34:59.569027 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.568958 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:34:59.673705 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673865 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.673893 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.673997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk2tg\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674131 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674450 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674450 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674450 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674450 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.674450 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.674359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775558 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775558 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775558 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775554 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775639 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.775841 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775864 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk2tg\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.775990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.776032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.776055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.776077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.776110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.776250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.776147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.777329 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.777298 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.777955 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.777896 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.778833 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.778524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.778833 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.778715 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.780610 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.780513 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.781234 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.781017 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.781587 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.781485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.786154 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.786105 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.791935 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.791839 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.792600 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.792543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.793277 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.793230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.793933 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.793867 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.794475 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.794430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.794824 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.794778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.795556 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.795513 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.797407 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.797364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.797843 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.797815 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.798997 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.798950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.803342 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.803246 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk2tg\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.805380 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.805308 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:34:59.864485 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.864435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:35:00.000266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.997954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqsz5" event={"ID":"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5","Type":"ContainerStarted","Data":"a96da230f203c75b91eab0eae35aff4c7f691f3ed075b733993b437de9861a3a"} Jul 15 22:35:00.000266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:34:59.998022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqsz5" event={"ID":"c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5","Type":"ContainerStarted","Data":"0c420c5aa8cb34c89e12fa8fe1aa0cee16c7614efd86bf65b1a76b517e534695"} Jul 15 22:35:00.033542 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:00.033428 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kqsz5" podStartSLOduration=2.97115127 podStartE2EDuration="7.03340312s" totalImagesPullingTime="3.831465047s" totalInitContainerRuntime="230.786803ms" isStatefulPod=true podCreationTimestamp="2026-07-15 22:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:00.029799392 +0000 UTC m=+93.120450649" watchObservedRunningTime="2026-07-15 22:35:00.03340312 +0000 UTC m=+93.124054363" Jul 15 22:35:03.784448 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:03.784033 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:35:03.790129 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:35:03.790102 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653f0f7a_e5ae_4058_a72a_a12af3dbecf1.slice/crio-99fd566dd6a62b6ce9a80059a7dcaec41f7aba1180ccc113415f2062be0813c4 WatchSource:0}: Error finding container 99fd566dd6a62b6ce9a80059a7dcaec41f7aba1180ccc113415f2062be0813c4: Status 404 returned error can't find the container with id 99fd566dd6a62b6ce9a80059a7dcaec41f7aba1180ccc113415f2062be0813c4 Jul 15 22:35:04.018309 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.018282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6"} Jul 15 22:35:04.018416 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.018384 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5"} Jul 15 22:35:04.020056 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.019942 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" exitCode=0 Jul 15 22:35:04.020056 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.020047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} Jul 15 22:35:04.020251 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.020111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"99fd566dd6a62b6ce9a80059a7dcaec41f7aba1180ccc113415f2062be0813c4"} Jul 15 22:35:04.022170 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.022111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" event={"ID":"845c202b-391b-402a-9dcb-340e38265a6b","Type":"ContainerStarted","Data":"39d54c508ecdb71c4ba70ed9d3978521e6280036763c3e7179c15c6090becd14"} Jul 15 22:35:04.024031 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.023988 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" event={"ID":"70299c0b-af28-46bb-90cb-765b24d8321c","Type":"ContainerStarted","Data":"d256775dde073021d02b10b733f95ebda2cbf8b51dd4b531eb28f9b01b19636b"} Jul 15 22:35:04.024130 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.024034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" event={"ID":"70299c0b-af28-46bb-90cb-765b24d8321c","Type":"ContainerStarted","Data":"7c8b53ab5c072dc2f53a8dd7e1df71659a5bee307ea85c778c8355b9b6eb57c7"} Jul 15 22:35:04.026039 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.026014 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"dac57edd570f01e3a85f87872740bd087930f0ddb5bd10f6952cbcfd72910187"} Jul 15 22:35:04.026135 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.026086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"fef9096b59a387ffe9d11b482d516bbcb7c3f8c4b2779393c41bb938d5273e93"} Jul 15 22:35:04.027682 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.027637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" event={"ID":"96744e76-2b4f-44ea-bbbb-f1113313616a","Type":"ContainerStarted","Data":"5cd2aab32e6e7efb557e4aa8d0c71c01ea0b7d794ff16a562d3a52087ee9b44b"} Jul 15 22:35:04.032251 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.032020 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:35:04.037845 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.037805 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" Jul 15 22:35:04.115825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.115350 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-b9g7c" podStartSLOduration=2.109716105 podStartE2EDuration="7.115331138s" totalImagesPullingTime="5.005615033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:04.113311783 +0000 UTC m=+97.203963026" watchObservedRunningTime="2026-07-15 22:35:04.115331138 +0000 UTC m=+97.205982379" Jul 15 22:35:04.159961 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:04.159692 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" podStartSLOduration=2.088762624 podStartE2EDuration="7.159668577s" totalImagesPullingTime="5.070905953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:04.159401933 +0000 UTC m=+97.250053188" watchObservedRunningTime="2026-07-15 22:35:04.159668577 +0000 UTC m=+97.250319822" Jul 15 22:35:05.037354 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.036569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" event={"ID":"70299c0b-af28-46bb-90cb-765b24d8321c","Type":"ContainerStarted","Data":"e65de8433fcc58859a671bc2240028c2fd284f428d09b4eb3d4eb47849906a7a"} Jul 15 22:35:05.040022 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.039931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"3999f0ed0eb29658a4e4f1faef17746f3d58f2edf06b5e03379cf6cdaaa81fdb"} Jul 15 22:35:05.044614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.044583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30"} Jul 15 22:35:05.044768 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.044698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7"} Jul 15 22:35:05.044768 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.044740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f"} Jul 15 22:35:05.081008 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.080940 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-95d85497f-txdgg" podStartSLOduration=2.372056616 podStartE2EDuration="7.080887887s" totalImagesPullingTime="4.708831271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:05.073764698 +0000 UTC m=+98.164415944" watchObservedRunningTime="2026-07-15 22:35:05.080887887 +0000 UTC m=+98.171539131" Jul 15 22:35:05.869642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:05.869605 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:35:06.053992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:06.053809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerStarted","Data":"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21"} Jul 15 22:35:06.105312 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:06.105252 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.881249426 podStartE2EDuration="12.105229051s" totalImagesPullingTime="9.180188155s" totalInitContainerRuntime="43.79147ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:06.103194852 +0000 UTC m=+99.193846134" watchObservedRunningTime="2026-07-15 22:35:06.105229051 +0000 UTC m=+99.195880290" Jul 15 22:35:07.063831 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:07.063794 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"e8a1cd1a6dde503f194843594988a5e20e81d662e9a759d07a5c3deddca79ff8"} Jul 15 22:35:07.652391 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:07.652352 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:35:08.072138 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.072016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} Jul 15 22:35:08.076393 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.076350 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"5ae6f21296e4c386aef440fafa4f6dd2882b1114111f36f85bcf26f232dcacec"} Jul 15 22:35:08.076560 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.076444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" event={"ID":"b4292db1-557d-4c0f-a001-ac5d1e8f5ae5","Type":"ContainerStarted","Data":"1dbc242a747d7b417ace0f9aa70fb670ae752aface943504576c83a4dc5ada51"} Jul 15 22:35:08.076726 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.076705 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:35:08.084985 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.084851 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" Jul 15 22:35:08.142461 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:08.142412 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59689dcdb7-4gpjh" podStartSLOduration=5.948718825 podStartE2EDuration="13.14239207s" totalImagesPullingTime="7.193673245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:08.13952209 +0000 UTC m=+101.230173333" watchObservedRunningTime="2026-07-15 22:35:08.14239207 +0000 UTC m=+101.233043312" Jul 15 22:35:09.085987 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.085939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} Jul 15 22:35:09.086392 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.086025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} Jul 15 22:35:09.086392 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.086056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} Jul 15 22:35:09.086392 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.086082 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} Jul 15 22:35:09.086392 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.086105 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerStarted","Data":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} Jul 15 22:35:09.131721 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.131654 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.294823792 podStartE2EDuration="10.131629278s" totalImagesPullingTime="3.797252635s" totalInitContainerRuntime="39.552851ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:09.128310606 +0000 UTC m=+102.218961852" watchObservedRunningTime="2026-07-15 22:35:09.131629278 +0000 UTC m=+102.222280521" Jul 15 22:35:09.865443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:09.865404 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:35:16.673195 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:16.673160 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:35:18.203774 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:18.203732 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:35:18.204192 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:18.203798 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:35:20.903182 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:20.903146 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-74kgh" Jul 15 22:35:20.982942 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:20.982883 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64f5b68d9b-65btn" podUID="7849f1c9-56b7-4fef-82c4-b37a7003e711" containerName="console" containerID="cri-o://805b95f841b0efccb6d9c978f27507deb35eeb1cd58ccf8172665f6faa0b76c9" gracePeriod=15 Jul 15 22:35:21.145622 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.145588 2556 generic.go:356] "Generic (PLEG): container finished" podID="7849f1c9-56b7-4fef-82c4-b37a7003e711" containerID="805b95f841b0efccb6d9c978f27507deb35eeb1cd58ccf8172665f6faa0b76c9" exitCode=0 Jul 15 22:35:21.145794 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.145674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5b68d9b-65btn" event={"ID":"7849f1c9-56b7-4fef-82c4-b37a7003e711","Type":"ContainerDied","Data":"805b95f841b0efccb6d9c978f27507deb35eeb1cd58ccf8172665f6faa0b76c9"} Jul 15 22:35:21.258176 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.258141 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:35:21.396862 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.396824 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.396890 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.396946 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.396998 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.397014 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397081 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.397043 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config\") pod \"7849f1c9-56b7-4fef-82c4-b37a7003e711\" (UID: \"7849f1c9-56b7-4fef-82c4-b37a7003e711\") " Jul 15 22:35:21.397368 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.397329 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:21.397427 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.397401 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config" (OuterVolumeSpecName: "console-config") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:21.397474 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.397410 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca" (OuterVolumeSpecName: "service-ca") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:21.399483 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.399451 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:21.399607 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.399548 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:21.399654 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.399593 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj" (OuterVolumeSpecName: "kube-api-access-4dxtj") pod "7849f1c9-56b7-4fef-82c4-b37a7003e711" (UID: "7849f1c9-56b7-4fef-82c4-b37a7003e711"). InnerVolumeSpecName "kube-api-access-4dxtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:21.498452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498410 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:21.498452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498443 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:21.498452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498452 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:21.498452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498460 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/7849f1c9-56b7-4fef-82c4-b37a7003e711-kube-api-access-4dxtj\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:21.498724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498469 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7849f1c9-56b7-4fef-82c4-b37a7003e711-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:21.498724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:21.498477 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7849f1c9-56b7-4fef-82c4-b37a7003e711-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:22.150688 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:22.150657 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5b68d9b-65btn" Jul 15 22:35:22.151284 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:22.150695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5b68d9b-65btn" event={"ID":"7849f1c9-56b7-4fef-82c4-b37a7003e711","Type":"ContainerDied","Data":"3237c30311212641384384410b24d50bd8372529ebf45812c3a71d1a44dc7cea"} Jul 15 22:35:22.151284 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:22.150757 2556 scope.go:117] "RemoveContainer" containerID="805b95f841b0efccb6d9c978f27507deb35eeb1cd58ccf8172665f6faa0b76c9" Jul 15 22:35:22.168853 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:22.168824 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:35:22.175830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:22.175803 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64f5b68d9b-65btn"] Jul 15 22:35:23.403990 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:23.403953 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7849f1c9-56b7-4fef-82c4-b37a7003e711" path="/var/lib/kubelet/pods/7849f1c9-56b7-4fef-82c4-b37a7003e711/volumes" Jul 15 22:35:30.896672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:30.896601 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59c4594d4d-hjdsz" podUID="9a4d9076-7570-47a5-b24f-f98692f0748f" containerName="console" containerID="cri-o://b3353d85898550039c7a9af6d34a57df3b6bc26b02a30afd90ee5aff91b48e07" gracePeriod=15 Jul 15 22:35:31.208301 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.208264 2556 generic.go:356] "Generic (PLEG): container finished" podID="9a4d9076-7570-47a5-b24f-f98692f0748f" containerID="b3353d85898550039c7a9af6d34a57df3b6bc26b02a30afd90ee5aff91b48e07" exitCode=0 Jul 15 22:35:31.208451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.208332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4594d4d-hjdsz" event={"ID":"9a4d9076-7570-47a5-b24f-f98692f0748f","Type":"ContainerDied","Data":"b3353d85898550039c7a9af6d34a57df3b6bc26b02a30afd90ee5aff91b48e07"} Jul 15 22:35:31.208451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.208384 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4594d4d-hjdsz" event={"ID":"9a4d9076-7570-47a5-b24f-f98692f0748f","Type":"ContainerDied","Data":"65e50656164e44934a1d154b79540b715c02042c407be088b9cab4c563a539d2"} Jul 15 22:35:31.208451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.208399 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65e50656164e44934a1d154b79540b715c02042c407be088b9cab4c563a539d2" Jul 15 22:35:31.223079 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.223042 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:35:31.387746 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387710 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.387939 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387766 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.387939 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387799 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.387939 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387839 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5klnk\" (UniqueName: \"kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.387939 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387921 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.388157 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387951 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.388157 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.387978 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle\") pod \"9a4d9076-7570-47a5-b24f-f98692f0748f\" (UID: \"9a4d9076-7570-47a5-b24f-f98692f0748f\") " Jul 15 22:35:31.388157 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388101 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:31.388314 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388190 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config" (OuterVolumeSpecName: "console-config") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:31.388365 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388335 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.388365 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388341 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:31.388458 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388354 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.388458 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.388386 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:31.390176 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.390153 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:31.390355 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.390333 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk" (OuterVolumeSpecName: "kube-api-access-5klnk") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "kube-api-access-5klnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:31.390488 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.390468 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a4d9076-7570-47a5-b24f-f98692f0748f" (UID: "9a4d9076-7570-47a5-b24f-f98692f0748f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:31.489351 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.489315 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.489351 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.489354 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.489546 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.489368 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a4d9076-7570-47a5-b24f-f98692f0748f-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.489546 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.489380 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a4d9076-7570-47a5-b24f-f98692f0748f-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:31.489546 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:31.489422 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5klnk\" (UniqueName: \"kubernetes.io/projected/9a4d9076-7570-47a5-b24f-f98692f0748f-kube-api-access-5klnk\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:32.212761 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:32.212721 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4594d4d-hjdsz" Jul 15 22:35:32.232985 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:32.232945 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:35:32.237346 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:32.237314 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c4594d4d-hjdsz"] Jul 15 22:35:33.403670 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:33.403633 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a4d9076-7570-47a5-b24f-f98692f0748f" path="/var/lib/kubelet/pods/9a4d9076-7570-47a5-b24f-f98692f0748f/volumes" Jul 15 22:35:38.208977 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:38.208946 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:35:38.212820 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:38.212795 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5878db4587-d7h5w" Jul 15 22:35:41.697006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:41.696957 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d7468d9bf-j9t7v" podUID="49fcb162-46c9-41bf-b3dc-ac453366a337" containerName="console" containerID="cri-o://e052e2c7f6b5804dce132ecafa798e546674b8081e9746676f0c55d78964e599" gracePeriod=15 Jul 15 22:35:42.264832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.264795 2556 generic.go:356] "Generic (PLEG): container finished" podID="49fcb162-46c9-41bf-b3dc-ac453366a337" containerID="e052e2c7f6b5804dce132ecafa798e546674b8081e9746676f0c55d78964e599" exitCode=0 Jul 15 22:35:42.265025 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.264840 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7468d9bf-j9t7v" event={"ID":"49fcb162-46c9-41bf-b3dc-ac453366a337","Type":"ContainerDied","Data":"e052e2c7f6b5804dce132ecafa798e546674b8081e9746676f0c55d78964e599"} Jul 15 22:35:42.481063 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.481023 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:35:42.589664 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589568 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589664 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589612 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xslkr\" (UniqueName: \"kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589664 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589628 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589687 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589707 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589722 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.589992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.589779 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert\") pod \"49fcb162-46c9-41bf-b3dc-ac453366a337\" (UID: \"49fcb162-46c9-41bf-b3dc-ac453366a337\") " Jul 15 22:35:42.590189 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.590040 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:42.590242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.590183 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:42.590445 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.590409 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config" (OuterVolumeSpecName: "console-config") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:42.590684 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.590655 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca" (OuterVolumeSpecName: "service-ca") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:35:42.592166 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.592134 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:42.592267 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.592194 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr" (OuterVolumeSpecName: "kube-api-access-xslkr") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "kube-api-access-xslkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:35:42.592267 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.592225 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49fcb162-46c9-41bf-b3dc-ac453366a337" (UID: "49fcb162-46c9-41bf-b3dc-ac453366a337"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:35:42.691440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691397 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691432 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691443 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xslkr\" (UniqueName: \"kubernetes.io/projected/49fcb162-46c9-41bf-b3dc-ac453366a337-kube-api-access-xslkr\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691453 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49fcb162-46c9-41bf-b3dc-ac453366a337-console-oauth-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691463 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-console-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691471 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-oauth-serving-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:42.691665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:42.691480 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49fcb162-46c9-41bf-b3dc-ac453366a337-service-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:35:43.270665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.270632 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7468d9bf-j9t7v" Jul 15 22:35:43.270665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.270641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7468d9bf-j9t7v" event={"ID":"49fcb162-46c9-41bf-b3dc-ac453366a337","Type":"ContainerDied","Data":"ef1454b0f8b7f0fbe4951de11adf43a1dcc23487339b5f980df3b0f15afb7ed7"} Jul 15 22:35:43.271202 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.270711 2556 scope.go:117] "RemoveContainer" containerID="e052e2c7f6b5804dce132ecafa798e546674b8081e9746676f0c55d78964e599" Jul 15 22:35:43.293997 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.293972 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:35:43.301107 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.301082 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7468d9bf-j9t7v"] Jul 15 22:35:43.403762 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:43.403721 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49fcb162-46c9-41bf-b3dc-ac453366a337" path="/var/lib/kubelet/pods/49fcb162-46c9-41bf-b3dc-ac453366a337/volumes" Jul 15 22:35:59.865316 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:59.865277 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:35:59.886082 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:35:59.886050 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:00.356056 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:00.356021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:13.506625 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.506586 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:13.507098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.506894 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="alertmanager" containerID="cri-o://bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5" gracePeriod=120 Jul 15 22:36:13.507098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.506981 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-web" containerID="cri-o://b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f" gracePeriod=120 Jul 15 22:36:13.507098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.507005 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="config-reloader" containerID="cri-o://3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6" gracePeriod=120 Jul 15 22:36:13.507098 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.507050 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="prom-label-proxy" containerID="cri-o://c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21" gracePeriod=120 Jul 15 22:36:13.507343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.507080 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy" containerID="cri-o://083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7" gracePeriod=120 Jul 15 22:36:13.507343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:13.507129 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-metric" containerID="cri-o://34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30" gracePeriod=120 Jul 15 22:36:14.399058 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399028 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21" exitCode=0 Jul 15 22:36:14.399058 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399054 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30" exitCode=0 Jul 15 22:36:14.399058 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399062 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7" exitCode=0 Jul 15 22:36:14.399058 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399067 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6" exitCode=0 Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399072 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5" exitCode=0 Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21"} Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399159 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30"} Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7"} Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6"} Jul 15 22:36:14.399331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.399249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5"} Jul 15 22:36:14.760926 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.760884 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:14.880536 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880499 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880536 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880547 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880580 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880635 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880663 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880694 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880730 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880755 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wbm7\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.880796 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880779 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.881137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880810 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.881137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880838 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.881137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880928 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.881137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880943 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:36:14.881137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.880978 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web\") pod \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\" (UID: \"0b891c57-cb8e-479b-b6b6-5c17579e2db4\") " Jul 15 22:36:14.881368 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.881246 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-main-db\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.881368 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.881342 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:14.883502 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.883465 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.883870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.883844 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:36:14.884501 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.884469 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.885294 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.884887 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume" (OuterVolumeSpecName: "config-volume") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.885294 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.885238 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:14.885958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.885831 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.885958 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.885929 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out" (OuterVolumeSpecName: "config-out") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:36:14.886366 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.886342 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7" (OuterVolumeSpecName: "kube-api-access-6wbm7") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "kube-api-access-6wbm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:36:14.886944 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.886889 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.889042 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.889016 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.896784 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.896750 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config" (OuterVolumeSpecName: "web-config") pod "0b891c57-cb8e-479b-b6b6-5c17579e2db4" (UID: "0b891c57-cb8e-479b-b6b6-5c17579e2db4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:14.982249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982208 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982246 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982258 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982267 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-main-tls\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982277 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-web-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982285 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wbm7\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-kube-api-access-6wbm7\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982293 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b891c57-cb8e-479b-b6b6-5c17579e2db4-tls-assets\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982301 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982309 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b891c57-cb8e-479b-b6b6-5c17579e2db4-metrics-client-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982317 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b891c57-cb8e-479b-b6b6-5c17579e2db4-config-out\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982325 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:14.982498 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:14.982333 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b891c57-cb8e-479b-b6b6-5c17579e2db4-cluster-tls-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:15.406666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.406583 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerID="b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f" exitCode=0 Jul 15 22:36:15.406666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.406658 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f"} Jul 15 22:36:15.406884 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.406673 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.406884 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.406730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b891c57-cb8e-479b-b6b6-5c17579e2db4","Type":"ContainerDied","Data":"8579404d444ab8b133141abcbb120aba6e59bd6f30f4bc95a04aa7eadc2f075a"} Jul 15 22:36:15.406884 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.406764 2556 scope.go:117] "RemoveContainer" containerID="c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21" Jul 15 22:36:15.417385 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.417354 2556 scope.go:117] "RemoveContainer" containerID="34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30" Jul 15 22:36:15.424570 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.424550 2556 scope.go:117] "RemoveContainer" containerID="083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7" Jul 15 22:36:15.431990 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.431965 2556 scope.go:117] "RemoveContainer" containerID="b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f" Jul 15 22:36:15.435018 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.434993 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:15.439798 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.439780 2556 scope.go:117] "RemoveContainer" containerID="3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6" Jul 15 22:36:15.444562 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.444539 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:15.448245 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.448229 2556 scope.go:117] "RemoveContainer" containerID="bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5" Jul 15 22:36:15.455696 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.455677 2556 scope.go:117] "RemoveContainer" containerID="8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc" Jul 15 22:36:15.463300 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.463279 2556 scope.go:117] "RemoveContainer" containerID="c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21" Jul 15 22:36:15.463574 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.463552 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21\": container with ID starting with c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21 not found: ID does not exist" containerID="c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21" Jul 15 22:36:15.463637 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.463585 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21"} err="failed to get container status \"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21\": rpc error: code = NotFound desc = could not find container \"c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21\": container with ID starting with c89e5a70caae441b055200b7a47ca3b87a3f07671b4b48b43b596ed44f606d21 not found: ID does not exist" Jul 15 22:36:15.463637 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.463618 2556 scope.go:117] "RemoveContainer" containerID="34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30" Jul 15 22:36:15.463868 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.463850 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30\": container with ID starting with 34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30 not found: ID does not exist" containerID="34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30" Jul 15 22:36:15.463956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.463925 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30"} err="failed to get container status \"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30\": rpc error: code = NotFound desc = could not find container \"34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30\": container with ID starting with 34c463063bb0acc15c921546fe1c2114e286282aaef374bb7ab47e52263c1f30 not found: ID does not exist" Jul 15 22:36:15.463956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.463949 2556 scope.go:117] "RemoveContainer" containerID="083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7" Jul 15 22:36:15.464179 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.464161 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7\": container with ID starting with 083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7 not found: ID does not exist" containerID="083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7" Jul 15 22:36:15.464236 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464185 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7"} err="failed to get container status \"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7\": rpc error: code = NotFound desc = could not find container \"083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7\": container with ID starting with 083ee235eef9c6a2a94b67d626715687cbc27cf79c926cf22d2d49d0671befa7 not found: ID does not exist" Jul 15 22:36:15.464236 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464200 2556 scope.go:117] "RemoveContainer" containerID="b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f" Jul 15 22:36:15.464401 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.464379 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f\": container with ID starting with b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f not found: ID does not exist" containerID="b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f" Jul 15 22:36:15.464446 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464411 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f"} err="failed to get container status \"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f\": rpc error: code = NotFound desc = could not find container \"b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f\": container with ID starting with b6790eb6b78511ee3e0a9e5ae5964d658dbb3d720b58001b00b35c297a4e735f not found: ID does not exist" Jul 15 22:36:15.464446 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464426 2556 scope.go:117] "RemoveContainer" containerID="3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6" Jul 15 22:36:15.464670 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.464656 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6\": container with ID starting with 3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6 not found: ID does not exist" containerID="3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6" Jul 15 22:36:15.464704 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464674 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6"} err="failed to get container status \"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6\": rpc error: code = NotFound desc = could not find container \"3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6\": container with ID starting with 3fb9ff4685d11a8c1e0c7d9b235d7afe34ddb56f393bbd7dd515548c579f0bc6 not found: ID does not exist" Jul 15 22:36:15.464704 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464685 2556 scope.go:117] "RemoveContainer" containerID="bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5" Jul 15 22:36:15.464957 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.464936 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5\": container with ID starting with bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5 not found: ID does not exist" containerID="bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5" Jul 15 22:36:15.465035 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464960 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5"} err="failed to get container status \"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5\": rpc error: code = NotFound desc = could not find container \"bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5\": container with ID starting with bd36df8283ffc607631abcd9e8642771fbbc5a19b49cf8db683f7aea4cccc5f5 not found: ID does not exist" Jul 15 22:36:15.465035 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.464974 2556 scope.go:117] "RemoveContainer" containerID="8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc" Jul 15 22:36:15.465273 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:15.465251 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc\": container with ID starting with 8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc not found: ID does not exist" containerID="8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc" Jul 15 22:36:15.465348 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.465279 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc"} err="failed to get container status \"8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc\": rpc error: code = NotFound desc = could not find container \"8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc\": container with ID starting with 8afeb15808e6bda60e031cb47f81dbef06ec94c395cb8f54fb7897affad0a2bc not found: ID does not exist" Jul 15 22:36:15.476745 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.476709 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:15.477092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477075 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="prom-label-proxy" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477093 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="prom-label-proxy" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477109 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="init-config-reloader" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477118 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="init-config-reloader" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477128 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="alertmanager" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477137 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="alertmanager" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477152 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="config-reloader" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477160 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="config-reloader" Jul 15 22:36:15.477175 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477173 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fcb162-46c9-41bf-b3dc-ac453366a337" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477181 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fcb162-46c9-41bf-b3dc-ac453366a337" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477190 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a4d9076-7570-47a5-b24f-f98692f0748f" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477200 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a4d9076-7570-47a5-b24f-f98692f0748f" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477216 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477226 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477243 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7849f1c9-56b7-4fef-82c4-b37a7003e711" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477252 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7849f1c9-56b7-4fef-82c4-b37a7003e711" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477266 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-web" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477276 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-web" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477289 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-metric" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477298 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-metric" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477374 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fcb162-46c9-41bf-b3dc-ac453366a337" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477387 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="prom-label-proxy" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477398 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-web" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477406 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="alertmanager" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477415 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy-metric" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477424 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="kube-rbac-proxy" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477434 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7849f1c9-56b7-4fef-82c4-b37a7003e711" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477443 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a4d9076-7570-47a5-b24f-f98692f0748f" containerName="console" Jul 15 22:36:15.477537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.477453 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" containerName="config-reloader" Jul 15 22:36:15.481602 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.481580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.486317 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.486295 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 22:36:15.486451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.486295 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 22:36:15.486451 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.486359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 22:36:15.486741 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.486725 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 22:36:15.487668 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.487331 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 22:36:15.487668 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.487398 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 22:36:15.487668 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.487521 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 22:36:15.487668 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.487544 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 22:36:15.488971 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.488949 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2sslt\"" Jul 15 22:36:15.495381 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.495363 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 22:36:15.507080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.507049 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:15.588686 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588654 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.588832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.588832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.588832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.588832 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-out\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.588992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-web-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.589023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbwj\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-kube-api-access-vcbwj\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589046 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.589048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.589242 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.589072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689670 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689670 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.689813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.689820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-out\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690317 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690594 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-web-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.690594 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.690504 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbwj\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-kube-api-access-vcbwj\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693191 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693393 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693470 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693470 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693470 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-out\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.693724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.693696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.694641 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.694613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.695637 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.695610 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4846d5-f656-425c-8a6d-d5dd90f8423c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.696138 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.696106 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.696377 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.696356 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-web-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.700001 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.699979 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.701121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.701091 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c4846d5-f656-425c-8a6d-d5dd90f8423c-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.702378 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.702360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbwj\" (UniqueName: \"kubernetes.io/projected/6c4846d5-f656-425c-8a6d-d5dd90f8423c-kube-api-access-vcbwj\") pod \"alertmanager-main-0\" (UID: \"6c4846d5-f656-425c-8a6d-d5dd90f8423c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.791668 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.791626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:36:15.950478 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:15.950392 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:36:15.955920 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:36:15.955874 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4846d5_f656_425c_8a6d_d5dd90f8423c.slice/crio-3a346cf81254d71cb941418edf7af80b072f1e8db345b64d2869ed968630d02c WatchSource:0}: Error finding container 3a346cf81254d71cb941418edf7af80b072f1e8db345b64d2869ed968630d02c: Status 404 returned error can't find the container with id 3a346cf81254d71cb941418edf7af80b072f1e8db345b64d2869ed968630d02c Jul 15 22:36:16.412304 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:16.412261 2556 generic.go:356] "Generic (PLEG): container finished" podID="6c4846d5-f656-425c-8a6d-d5dd90f8423c" containerID="f960a99735001ac25134cadd5e90b15b143154ae739488c665a521edfa1a84f0" exitCode=0 Jul 15 22:36:16.412452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:16.412351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerDied","Data":"f960a99735001ac25134cadd5e90b15b143154ae739488c665a521edfa1a84f0"} Jul 15 22:36:16.412452 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:16.412425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"3a346cf81254d71cb941418edf7af80b072f1e8db345b64d2869ed968630d02c"} Jul 15 22:36:17.403570 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.403533 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b891c57-cb8e-479b-b6b6-5c17579e2db4" path="/var/lib/kubelet/pods/0b891c57-cb8e-479b-b6b6-5c17579e2db4/volumes" Jul 15 22:36:17.420596 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"93206a69a6ccdb2b2169521ad2aca6d9fe031573610239c3d6909a25e0d138ac"} Jul 15 22:36:17.420753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"e74db01751856fa310e00c09c618de2c1ac2c2aedd165082048f838e81ef8dff"} Jul 15 22:36:17.420753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"475baf106f4c884f9d7ed819e791588a92f38ac9d69addf0cc7c947277c07b97"} Jul 15 22:36:17.420753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"fd0003e5ecbddc1d6a3cb640a1d4aef875fb351c474ed85e596dbe6e351804e5"} Jul 15 22:36:17.420753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"61f57021a4badcd921001062b5ce960f1a5f187de40f2ac6a76da58972fbc8d1"} Jul 15 22:36:17.420753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.420741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c4846d5-f656-425c-8a6d-d5dd90f8423c","Type":"ContainerStarted","Data":"0c8ad473e4fa98b5c7146f1183946dde78070e544d38fee8cbf51a592f299331"} Jul 15 22:36:17.452176 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.452051 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.432551841 podStartE2EDuration="2.452028061s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.47622ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:36:17.450013147 +0000 UTC m=+170.540664392" watchObservedRunningTime="2026-07-15 22:36:17.452028061 +0000 UTC m=+170.542679315" Jul 15 22:36:17.823645 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.823602 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:17.824204 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824167 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="prometheus" containerID="cri-o://9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" gracePeriod=600 Jul 15 22:36:17.825038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824673 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" gracePeriod=600 Jul 15 22:36:17.825038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824762 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="thanos-sidecar" containerID="cri-o://9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" gracePeriod=600 Jul 15 22:36:17.825038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824819 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="config-reloader" containerID="cri-o://4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" gracePeriod=600 Jul 15 22:36:17.825038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824973 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-web" containerID="cri-o://b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" gracePeriod=600 Jul 15 22:36:17.825310 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:17.824974 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy" containerID="cri-o://3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" gracePeriod=600 Jul 15 22:36:18.107103 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.107028 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.216516 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216488 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216516 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216520 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216548 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk2tg\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216578 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216600 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216616 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216651 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216684 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.216718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216708 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216760 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216784 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216811 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216834 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216864 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216892 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216946 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.216972 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217001 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217034 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217059 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca\") pod \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\" (UID: \"653f0f7a-e5ae-4058-a72a-a12af3dbecf1\") " Jul 15 22:36:18.217786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217261 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.217786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217398 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.218672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.217889 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.218672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.218239 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.218672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.218300 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.218672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.218625 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:36:18.220070 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.219959 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.220166 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.220103 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.220542 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.220514 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.220722 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.220701 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:36:18.221478 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221452 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.221657 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221632 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config" (OuterVolumeSpecName: "config") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.221736 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221700 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.221825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221804 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out" (OuterVolumeSpecName: "config-out") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:36:18.221825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221813 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:36:18.222114 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.222114 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.221843 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg" (OuterVolumeSpecName: "kube-api-access-nk2tg") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "kube-api-access-nk2tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:36:18.222114 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.222100 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.222406 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.222380 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.223300 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.223281 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.231206 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.231186 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config" (OuterVolumeSpecName: "web-config") pod "653f0f7a-e5ae-4058-a72a-a12af3dbecf1" (UID: "653f0f7a-e5ae-4058-a72a-a12af3dbecf1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:36:18.317924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317846 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.317924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317889 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.317924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317930 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317942 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317951 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317984 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-db\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.317994 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318003 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318013 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-metrics-client-certs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318022 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318031 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-configmap-metrics-client-ca\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318041 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-tls-assets\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318049 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318057 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk2tg\" (UniqueName: \"kubernetes.io/projected/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-kube-api-access-nk2tg\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318064 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-config-out\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318072 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-web-config\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318081 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-kube-rbac-proxy\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318088 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-secret-grpc-tls\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.318168 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.318096 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/653f0f7a-e5ae-4058-a72a-a12af3dbecf1-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428109 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428135 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428141 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428147 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428153 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428159 2556 generic.go:356] "Generic (PLEG): container finished" podID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" exitCode=0 Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428179 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} Jul 15 22:36:18.428201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428198 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428307 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428358 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428380 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428404 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} Jul 15 22:36:18.428975 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.428428 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"653f0f7a-e5ae-4058-a72a-a12af3dbecf1","Type":"ContainerDied","Data":"99fd566dd6a62b6ce9a80059a7dcaec41f7aba1180ccc113415f2062be0813c4"} Jul 15 22:36:18.437627 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.437603 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.445201 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.445181 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.452681 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.452653 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:18.453470 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.453452 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.456665 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.456639 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:18.461658 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.461638 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.470783 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.470761 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.478981 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.478936 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.481105 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481082 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:18.481398 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481386 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="thanos-sidecar" Jul 15 22:36:18.481440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481399 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="thanos-sidecar" Jul 15 22:36:18.481440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481408 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-thanos" Jul 15 22:36:18.481440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481413 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-thanos" Jul 15 22:36:18.481440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481423 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-web" Jul 15 22:36:18.481440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481429 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-web" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481442 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="config-reloader" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481448 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="config-reloader" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481454 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="prometheus" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481460 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="prometheus" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481469 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="init-config-reloader" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481474 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="init-config-reloader" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481482 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481487 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481537 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="config-reloader" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481545 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-thanos" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481552 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy-web" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481558 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="kube-rbac-proxy" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481564 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="thanos-sidecar" Jul 15 22:36:18.481609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.481571 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" containerName="prometheus" Jul 15 22:36:18.484121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.484096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.487493 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487469 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.487829 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487811 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 22:36:18.487988 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.487846 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.487988 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487878 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.487988 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487811 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 22:36:18.487988 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487944 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 22:36:18.487988 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487980 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 22:36:18.488243 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.487921 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.488289 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488252 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 22:36:18.488345 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488286 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 22:36:18.488345 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488319 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 22:36:18.488439 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.488358 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.488439 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488387 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.488439 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488410 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.488775 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488810 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-k426cbqmtarj\"" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488806 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488829 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488856 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 22:36:18.488949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.488930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 22:36:18.489509 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.489241 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.489509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.489270 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.489509 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.489304 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.489693 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.489663 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.489807 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.489701 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.489807 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.489750 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.490247 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.490118 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.490247 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490150 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.490247 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490170 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.490247 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490180 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 22:36:18.490576 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:36:18.490541 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.490656 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490574 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.490656 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490592 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.490868 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490843 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.491006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.490868 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.491244 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491214 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.491336 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491248 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.491429 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491390 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 22:36:18.491502 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491433 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kw966\"" Jul 15 22:36:18.491638 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491614 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.491638 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491636 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.491961 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491936 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.492049 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.491962 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.492298 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492211 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.492298 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492235 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.492523 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492475 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.492523 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492499 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.492870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492848 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.492870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.492869 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.493131 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493112 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.493196 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493131 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.493422 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493395 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.493500 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493424 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.493694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493672 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.493753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493695 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.493956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493937 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.493956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.493954 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.494094 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494012 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 22:36:18.494192 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494175 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.494192 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494191 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.494391 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494373 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.494391 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494391 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.494595 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494575 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.494673 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494600 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.494843 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494827 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.494934 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.494845 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.495117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495101 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.495165 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495118 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.495341 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495321 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.495387 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495344 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.495539 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495522 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.495576 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495539 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.495725 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495709 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.495762 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495725 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.495936 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495891 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.495978 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.495936 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.496131 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496116 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.496177 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496131 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.496319 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496302 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.496357 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496318 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.496527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496509 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.496587 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496530 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.496730 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496712 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.496771 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496731 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.496955 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496938 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.497006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.496955 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.497144 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497125 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.497192 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497144 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.497315 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497300 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.497358 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497315 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.497479 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497459 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.497522 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497481 2556 scope.go:117] "RemoveContainer" containerID="5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865" Jul 15 22:36:18.497639 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497624 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865"} err="failed to get container status \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": rpc error: code = NotFound desc = could not find container \"5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865\": container with ID starting with 5738b0401608affc318804784e19744b126aed445b5089170e4eb93f3c9af865 not found: ID does not exist" Jul 15 22:36:18.497677 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497638 2556 scope.go:117] "RemoveContainer" containerID="3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486" Jul 15 22:36:18.497804 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497788 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486"} err="failed to get container status \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": rpc error: code = NotFound desc = could not find container \"3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486\": container with ID starting with 3789d257a0eabf0d8bd5a2f3a237400e90c336294fa6dee27fb103bb7a97a486 not found: ID does not exist" Jul 15 22:36:18.497845 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497803 2556 scope.go:117] "RemoveContainer" containerID="b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e" Jul 15 22:36:18.498001 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.497980 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e"} err="failed to get container status \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": rpc error: code = NotFound desc = could not find container \"b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e\": container with ID starting with b54f2d0c7d6e6b5776c57cf81a5f1360622e0f943dc210a1a66b67f46887982e not found: ID does not exist" Jul 15 22:36:18.498080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498002 2556 scope.go:117] "RemoveContainer" containerID="9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf" Jul 15 22:36:18.498197 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498182 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf"} err="failed to get container status \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": rpc error: code = NotFound desc = could not find container \"9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf\": container with ID starting with 9d97c8c13483376c6922f592a61eeb08b85f0f5bb76c02447abc772608d90bbf not found: ID does not exist" Jul 15 22:36:18.498237 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498199 2556 scope.go:117] "RemoveContainer" containerID="4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008" Jul 15 22:36:18.498384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498370 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008"} err="failed to get container status \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": rpc error: code = NotFound desc = could not find container \"4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008\": container with ID starting with 4ef5b3d08871ed3cfc396c644c36f43d77dc1ebfb2ac756424245b61d86fc008 not found: ID does not exist" Jul 15 22:36:18.498421 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498385 2556 scope.go:117] "RemoveContainer" containerID="9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80" Jul 15 22:36:18.498605 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498588 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80"} err="failed to get container status \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": rpc error: code = NotFound desc = could not find container \"9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80\": container with ID starting with 9f3fb1530614242154d11dc1d1cecb9cb37c638c37073ab8df2b2d65e9566b80 not found: ID does not exist" Jul 15 22:36:18.498644 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498605 2556 scope.go:117] "RemoveContainer" containerID="f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7" Jul 15 22:36:18.498802 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.498786 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7"} err="failed to get container status \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": rpc error: code = NotFound desc = could not find container \"f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7\": container with ID starting with f4d8814479c1939705d1e3100fbb4a3c6950ee13a7e24c28dfac22245c96a9d7 not found: ID does not exist" Jul 15 22:36:18.503361 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.503336 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:18.620548 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620585 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620718 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhbf\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-kube-api-access-bkhbf\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620822 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.620991 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.621343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.620991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.621343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.621040 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.621343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.621073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.621343 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.621109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722497 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722663 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722504 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722663 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhbf\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-kube-api-access-bkhbf\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722663 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722746 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.722789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.722976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723256 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723495 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.723927 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.723852 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.724556 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.724245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.724683 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.724729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.725194 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.726075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.726261 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.726493 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.726646 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ba1d514-898c-4ac1-9e24-23daa51b01ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.727407 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.727675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.727573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.728249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.727960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.728249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.728046 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.728249 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.728121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.728683 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.728663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.728749 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.728708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ba1d514-898c-4ac1-9e24-23daa51b01ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.729137 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.729121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ba1d514-898c-4ac1-9e24-23daa51b01ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.731005 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.730988 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhbf\" (UniqueName: \"kubernetes.io/projected/2ba1d514-898c-4ac1-9e24-23daa51b01ec-kube-api-access-bkhbf\") pod \"prometheus-k8s-0\" (UID: \"2ba1d514-898c-4ac1-9e24-23daa51b01ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.795238 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.795182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:36:18.941247 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:18.940938 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 22:36:18.943758 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:36:18.943730 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba1d514_898c_4ac1_9e24_23daa51b01ec.slice/crio-96a8230cdde6eb17447097445fce5c34d50bcf7f622ff9ed1506fb5e076e59ec WatchSource:0}: Error finding container 96a8230cdde6eb17447097445fce5c34d50bcf7f622ff9ed1506fb5e076e59ec: Status 404 returned error can't find the container with id 96a8230cdde6eb17447097445fce5c34d50bcf7f622ff9ed1506fb5e076e59ec Jul 15 22:36:19.403850 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:19.403769 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="653f0f7a-e5ae-4058-a72a-a12af3dbecf1" path="/var/lib/kubelet/pods/653f0f7a-e5ae-4058-a72a-a12af3dbecf1/volumes" Jul 15 22:36:19.436611 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:19.436582 2556 generic.go:356] "Generic (PLEG): container finished" podID="2ba1d514-898c-4ac1-9e24-23daa51b01ec" containerID="ff23f882b596bff226d85cb71c352042c221c7ada1868c4ba5ce2df3d8a64973" exitCode=0 Jul 15 22:36:19.437012 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:19.436650 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerDied","Data":"ff23f882b596bff226d85cb71c352042c221c7ada1868c4ba5ce2df3d8a64973"} Jul 15 22:36:19.437012 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:19.436706 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"96a8230cdde6eb17447097445fce5c34d50bcf7f622ff9ed1506fb5e076e59ec"} Jul 15 22:36:20.445148 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"59b9a76a96872e14c6fba6c79b55248095103ef2ab0605a97365f0137a8bf2c0"} Jul 15 22:36:20.445598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"276457d4dd37328f7e237a4944a939596a8e7ab3f05378d21db5e07196b5c0d7"} Jul 15 22:36:20.445598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445205 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"25611a3e5a1b6f4d26f13370db9678359d330cd20570e748402908804604e9f6"} Jul 15 22:36:20.445598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"ed269fef352a745c6b2c663b7714b4bc559f15f59a16cad7bd80002cd704f973"} Jul 15 22:36:20.445598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"e37e35cff27d74ad956c3e95e7c485cf4115edd5852d3ae4e7dea2f2e6ec39b9"} Jul 15 22:36:20.445598 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.445281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ba1d514-898c-4ac1-9e24-23daa51b01ec","Type":"ContainerStarted","Data":"99a1df098173d9e6ca0b144d6863fcf3e7dc384a4d21472ce05df9f4b8c64c26"} Jul 15 22:36:20.477326 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:20.477266 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.455273287 podStartE2EDuration="2.477247466s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.974179ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:36:20.474844222 +0000 UTC m=+173.565495466" watchObservedRunningTime="2026-07-15 22:36:20.477247466 +0000 UTC m=+173.567898708" Jul 15 22:36:23.796023 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:36:23.795983 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:37:18.795855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:18.795803 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:37:18.812617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:18.812593 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:37:19.709436 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:19.709407 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 22:37:44.649134 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.649101 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2"] Jul 15 22:37:44.652913 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.652879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.655586 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.655564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jf9tx\"" Jul 15 22:37:44.655708 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.655596 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 22:37:44.656924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.656885 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 22:37:44.660261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.660092 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2"] Jul 15 22:37:44.800571 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.800539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-kube-api-access-5gjxn\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.800758 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.800600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.902034 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.901892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-kube-api-access-5gjxn\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.902034 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.902038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.910655 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.910626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.910849 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.910826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/7799c903-483b-4095-b4e6-10427e16b138-kube-api-access-5gjxn\") pod \"cert-manager-cainjector-559cdd8c87-qr8q2\" (UID: \"7799c903-483b-4095-b4e6-10427e16b138\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:44.972206 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:44.972159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" Jul 15 22:37:45.105412 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:45.105386 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2"] Jul 15 22:37:45.108017 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:37:45.107983 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7799c903_483b_4095_b4e6_10427e16b138.slice/crio-0d09e73aab64ed8a8b70d86ef8dd426c39602ba807553b29129e3b9755934864 WatchSource:0}: Error finding container 0d09e73aab64ed8a8b70d86ef8dd426c39602ba807553b29129e3b9755934864: Status 404 returned error can't find the container with id 0d09e73aab64ed8a8b70d86ef8dd426c39602ba807553b29129e3b9755934864 Jul 15 22:37:45.802104 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:45.802069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" event={"ID":"7799c903-483b-4095-b4e6-10427e16b138","Type":"ContainerStarted","Data":"0d09e73aab64ed8a8b70d86ef8dd426c39602ba807553b29129e3b9755934864"} Jul 15 22:37:48.013966 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.013851 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f7pc9"] Jul 15 22:37:48.018006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.017980 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.022688 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.021359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-drpgc\"" Jul 15 22:37:48.027121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.027088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f7pc9"] Jul 15 22:37:48.131809 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.131760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnhzw\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-kube-api-access-nnhzw\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.131809 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.131810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.232574 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.232525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnhzw\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-kube-api-access-nnhzw\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.232574 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.232576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.242996 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.242966 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.243146 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.243084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnhzw\" (UniqueName: \"kubernetes.io/projected/c1e59aa2-7dee-4327-840b-37c22a0e4cd4-kube-api-access-nnhzw\") pod \"cert-manager-55b4d954d5-f7pc9\" (UID: \"c1e59aa2-7dee-4327-840b-37c22a0e4cd4\") " pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.333518 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.333427 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f7pc9" Jul 15 22:37:48.746053 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.745990 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f7pc9"] Jul 15 22:37:48.748554 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:37:48.748529 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e59aa2_7dee_4327_840b_37c22a0e4cd4.slice/crio-3dc731cd35e6e2eb32e66391a4db4c8ed9a4922661f8ef5f08e2c9fc1fabf886 WatchSource:0}: Error finding container 3dc731cd35e6e2eb32e66391a4db4c8ed9a4922661f8ef5f08e2c9fc1fabf886: Status 404 returned error can't find the container with id 3dc731cd35e6e2eb32e66391a4db4c8ed9a4922661f8ef5f08e2c9fc1fabf886 Jul 15 22:37:48.819790 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.819737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f7pc9" event={"ID":"c1e59aa2-7dee-4327-840b-37c22a0e4cd4","Type":"ContainerStarted","Data":"3dc731cd35e6e2eb32e66391a4db4c8ed9a4922661f8ef5f08e2c9fc1fabf886"} Jul 15 22:37:48.821594 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.821559 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" event={"ID":"7799c903-483b-4095-b4e6-10427e16b138","Type":"ContainerStarted","Data":"944c6898e60d0163793baee4552646a3437f455aa4996bf0dcedbb01494b4efa"} Jul 15 22:37:48.839666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:48.839276 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qr8q2" podStartSLOduration=1.259273716 podStartE2EDuration="4.839253042s" totalImagesPullingTime="3.579979326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:37:48.838364492 +0000 UTC m=+261.929015741" watchObservedRunningTime="2026-07-15 22:37:48.839253042 +0000 UTC m=+261.929904285" Jul 15 22:37:49.827889 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:49.827848 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f7pc9" event={"ID":"c1e59aa2-7dee-4327-840b-37c22a0e4cd4","Type":"ContainerStarted","Data":"ce632b45c2d32b4c6177b1bd174d446250e276d8d94a6ea1d4c5f3b784417812"} Jul 15 22:37:49.845686 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:37:49.845633 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f7pc9" podStartSLOduration=2.845616016 podStartE2EDuration="2.845616016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:37:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:37:49.844156918 +0000 UTC m=+262.934808160" watchObservedRunningTime="2026-07-15 22:37:49.845616016 +0000 UTC m=+262.936267259" Jul 15 22:38:13.726341 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.726308 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7"] Jul 15 22:38:13.730053 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.730033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.733243 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.733221 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:38:13.733375 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.733224 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 22:38:13.741624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.741593 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 22:38:13.741998 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.741981 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 22:38:13.742059 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.742032 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 22:38:13.742234 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.742220 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zhsgl\"" Jul 15 22:38:13.751546 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.751516 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7"] Jul 15 22:38:13.863508 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.863470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f39d73c-4676-46dc-ba7b-81d0c744e264-manager-config\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.863687 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.863531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p54tf\" (UniqueName: \"kubernetes.io/projected/1f39d73c-4676-46dc-ba7b-81d0c744e264-kube-api-access-p54tf\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.863687 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.863576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.863687 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.863639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.964686 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.964647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.964686 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.964691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.965012 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.964831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f39d73c-4676-46dc-ba7b-81d0c744e264-manager-config\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.965012 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.964934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p54tf\" (UniqueName: \"kubernetes.io/projected/1f39d73c-4676-46dc-ba7b-81d0c744e264-kube-api-access-p54tf\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.965583 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.965495 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f39d73c-4676-46dc-ba7b-81d0c744e264-manager-config\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.967459 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.967426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.967568 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.967473 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f39d73c-4676-46dc-ba7b-81d0c744e264-metrics-cert\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:13.973825 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:13.973797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p54tf\" (UniqueName: \"kubernetes.io/projected/1f39d73c-4676-46dc-ba7b-81d0c744e264-kube-api-access-p54tf\") pod \"lws-controller-manager-5cf7bf55db-pk4q7\" (UID: \"1f39d73c-4676-46dc-ba7b-81d0c744e264\") " pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:14.040370 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:14.040289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:14.215456 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:14.215427 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7"] Jul 15 22:38:14.218368 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:38:14.218330 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f39d73c_4676_46dc_ba7b_81d0c744e264.slice/crio-8d1124d4de3733106423391e39b1fa4467b23a970026fab15bf3cdb85ba32b23 WatchSource:0}: Error finding container 8d1124d4de3733106423391e39b1fa4467b23a970026fab15bf3cdb85ba32b23: Status 404 returned error can't find the container with id 8d1124d4de3733106423391e39b1fa4467b23a970026fab15bf3cdb85ba32b23 Jul 15 22:38:14.940109 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:14.940060 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" event={"ID":"1f39d73c-4676-46dc-ba7b-81d0c744e264","Type":"ContainerStarted","Data":"8d1124d4de3733106423391e39b1fa4467b23a970026fab15bf3cdb85ba32b23"} Jul 15 22:38:16.951517 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:16.951427 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" event={"ID":"1f39d73c-4676-46dc-ba7b-81d0c744e264","Type":"ContainerStarted","Data":"055d54e371460668574d38883cd6ec283901e68eeb510932945da1b0f9442602"} Jul 15 22:38:16.951930 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:16.951686 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:16.974208 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:16.974149 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" podStartSLOduration=1.500861996 podStartE2EDuration="3.974130468s" totalImagesPullingTime="2.473268472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:16.972805935 +0000 UTC m=+290.063457190" watchObservedRunningTime="2026-07-15 22:38:16.974130468 +0000 UTC m=+290.064781712" Jul 15 22:38:17.910360 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.910323 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f"] Jul 15 22:38:17.913838 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.913819 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:17.916833 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.916744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 22:38:17.917172 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.917153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vzbsj\"" Jul 15 22:38:17.917768 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.917744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 22:38:17.917882 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.917749 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 22:38:17.918188 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.918168 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 22:38:17.941170 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:17.941140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f"] Jul 15 22:38:18.003734 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.003698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.004256 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.003878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.004256 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.003972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.004256 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.004003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.004256 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.004117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrht6\" (UniqueName: \"kubernetes.io/projected/4488d486-0ebb-4ee1-95fb-da80f1178a42-kube-api-access-mrht6\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.105315 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105274 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.105518 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.105518 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.105518 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrht6\" (UniqueName: \"kubernetes.io/projected/4488d486-0ebb-4ee1-95fb-da80f1178a42-kube-api-access-mrht6\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.105851 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-manifests\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.106000 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.105887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.108007 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.107978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4488d486-0ebb-4ee1-95fb-da80f1178a42-tmp\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.108229 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.108199 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-webhook-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.108478 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.108458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4488d486-0ebb-4ee1-95fb-da80f1178a42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.116173 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.116136 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrht6\" (UniqueName: \"kubernetes.io/projected/4488d486-0ebb-4ee1-95fb-da80f1178a42-kube-api-access-mrht6\") pod \"opendatahub-operator-controller-manager-7db6597b7c-6ch8f\" (UID: \"4488d486-0ebb-4ee1-95fb-da80f1178a42\") " pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.224294 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.224259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:18.368033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.367949 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f"] Jul 15 22:38:18.370646 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:38:18.370617 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4488d486_0ebb_4ee1_95fb_da80f1178a42.slice/crio-fb7e85c6daeff51b264e6550d8c14df2e6d0efb580ff6e23d4c5972dca2bfcdb WatchSource:0}: Error finding container fb7e85c6daeff51b264e6550d8c14df2e6d0efb580ff6e23d4c5972dca2bfcdb: Status 404 returned error can't find the container with id fb7e85c6daeff51b264e6550d8c14df2e6d0efb580ff6e23d4c5972dca2bfcdb Jul 15 22:38:18.961627 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:18.961591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" event={"ID":"4488d486-0ebb-4ee1-95fb-da80f1178a42","Type":"ContainerStarted","Data":"fb7e85c6daeff51b264e6550d8c14df2e6d0efb580ff6e23d4c5972dca2bfcdb"} Jul 15 22:38:22.987443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:22.987401 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" event={"ID":"4488d486-0ebb-4ee1-95fb-da80f1178a42","Type":"ContainerStarted","Data":"82de1670ec6f05f27a4dc7b2272ef8d010540dc2644f6a0ec409fc48d67dc4b6"} Jul 15 22:38:23.993389 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:23.993352 2556 generic.go:356] "Generic (PLEG): container finished" podID="4488d486-0ebb-4ee1-95fb-da80f1178a42" containerID="82de1670ec6f05f27a4dc7b2272ef8d010540dc2644f6a0ec409fc48d67dc4b6" exitCode=0 Jul 15 22:38:23.993813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:23.993429 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" event={"ID":"4488d486-0ebb-4ee1-95fb-da80f1178a42","Type":"ContainerDied","Data":"82de1670ec6f05f27a4dc7b2272ef8d010540dc2644f6a0ec409fc48d67dc4b6"} Jul 15 22:38:25.000401 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:25.000363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" event={"ID":"4488d486-0ebb-4ee1-95fb-da80f1178a42","Type":"ContainerStarted","Data":"f06e42793638999f15444ac528b36b49d434d98a7bd6c2ed70c4da19d50a0c51"} Jul 15 22:38:25.000801 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:25.000477 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:25.026681 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:25.026625 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" podStartSLOduration=3.088629949 podStartE2EDuration="8.02660701s" totalImagesPullingTime="3.943032338s" totalInitContainerRuntime="994.944723ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:25.024657854 +0000 UTC m=+298.115309099" watchObservedRunningTime="2026-07-15 22:38:25.02660701 +0000 UTC m=+298.117258252" Jul 15 22:38:27.300075 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:27.300043 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:38:27.300472 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:27.300203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:38:27.305413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:27.305393 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 22:38:27.958586 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:27.958554 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf7bf55db-pk4q7" Jul 15 22:38:36.007795 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:36.007765 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7db6597b7c-6ch8f" Jul 15 22:38:38.211332 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.211297 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2"] Jul 15 22:38:38.214886 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.214861 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.220123 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.220095 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 22:38:38.220297 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.220274 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 22:38:38.220586 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.220556 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 22:38:38.221567 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.221388 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r8c4t\"" Jul 15 22:38:38.221637 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.221592 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 22:38:38.227949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.227926 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2"] Jul 15 22:38:38.301120 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.301084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e111012-c861-49d1-aafc-743b2bf400fd-tls-certs\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.301297 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.301138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrlb\" (UniqueName: \"kubernetes.io/projected/8e111012-c861-49d1-aafc-743b2bf400fd-kube-api-access-ddrlb\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.301297 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.301230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e111012-c861-49d1-aafc-743b2bf400fd-tmp\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.402200 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.402165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrlb\" (UniqueName: \"kubernetes.io/projected/8e111012-c861-49d1-aafc-743b2bf400fd-kube-api-access-ddrlb\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.402402 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.402226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e111012-c861-49d1-aafc-743b2bf400fd-tmp\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.402402 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.402271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e111012-c861-49d1-aafc-743b2bf400fd-tls-certs\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.404738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.404712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e111012-c861-49d1-aafc-743b2bf400fd-tmp\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.404963 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.404945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e111012-c861-49d1-aafc-743b2bf400fd-tls-certs\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.430289 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.430258 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrlb\" (UniqueName: \"kubernetes.io/projected/8e111012-c861-49d1-aafc-743b2bf400fd-kube-api-access-ddrlb\") pod \"kube-auth-proxy-69cf9c9cdb-6ddf2\" (UID: \"8e111012-c861-49d1-aafc-743b2bf400fd\") " pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.524599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.524504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" Jul 15 22:38:38.674971 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.674942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2"] Jul 15 22:38:38.677686 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:38:38.677654 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e111012_c861_49d1_aafc_743b2bf400fd.slice/crio-280a5969960dc3563fbb4861ddef11a048063435e3bd09ebbf1e0541f50f6014 WatchSource:0}: Error finding container 280a5969960dc3563fbb4861ddef11a048063435e3bd09ebbf1e0541f50f6014: Status 404 returned error can't find the container with id 280a5969960dc3563fbb4861ddef11a048063435e3bd09ebbf1e0541f50f6014 Jul 15 22:38:38.679535 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:38.679518 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:38:39.072078 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:39.072042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" event={"ID":"8e111012-c861-49d1-aafc-743b2bf400fd","Type":"ContainerStarted","Data":"280a5969960dc3563fbb4861ddef11a048063435e3bd09ebbf1e0541f50f6014"} Jul 15 22:38:42.088454 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:42.088418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" event={"ID":"8e111012-c861-49d1-aafc-743b2bf400fd","Type":"ContainerStarted","Data":"67c510300000819484e9ab93e9f163ad879086271817161a669fe1e8e9f44b3e"} Jul 15 22:38:42.108362 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:38:42.108309 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69cf9c9cdb-6ddf2" podStartSLOduration=1.545074268 podStartE2EDuration="4.108293098s" totalImagesPullingTime="2.56321883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:38:42.106152764 +0000 UTC m=+315.196804008" watchObservedRunningTime="2026-07-15 22:38:42.108293098 +0000 UTC m=+315.198944340" Jul 15 22:40:06.809614 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.809569 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c565dcc8c-zpm7r"] Jul 15 22:40:06.813208 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.813178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.816179 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.816147 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 22:40:06.818487 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.818453 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zxb9h\"" Jul 15 22:40:06.818612 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.818503 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 22:40:06.818679 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.818610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 22:40:06.818733 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.818681 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 22:40:06.818937 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.818917 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 22:40:06.822125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.822098 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c565dcc8c-zpm7r"] Jul 15 22:40:06.823261 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.823243 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 22:40:06.923642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-trusted-ca-bundle\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.923642 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-console-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.923896 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.923896 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-oauth-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.923896 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-oauth-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.923896 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-service-ca\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:06.924051 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:06.923889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfl9h\" (UniqueName: \"kubernetes.io/projected/13a3bc95-6c08-450b-8a74-bc21330586f2-kube-api-access-xfl9h\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024408 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-trusted-ca-bundle\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024408 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-console-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-oauth-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-oauth-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-service-ca\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.024631 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.024608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfl9h\" (UniqueName: \"kubernetes.io/projected/13a3bc95-6c08-450b-8a74-bc21330586f2-kube-api-access-xfl9h\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.025291 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.025265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-oauth-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.025393 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.025298 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-console-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.025393 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.025315 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-service-ca\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.025393 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.025361 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13a3bc95-6c08-450b-8a74-bc21330586f2-trusted-ca-bundle\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.027609 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.027589 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-serving-cert\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.027724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.027703 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13a3bc95-6c08-450b-8a74-bc21330586f2-console-oauth-config\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.036211 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.036180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfl9h\" (UniqueName: \"kubernetes.io/projected/13a3bc95-6c08-450b-8a74-bc21330586f2-kube-api-access-xfl9h\") pod \"console-c565dcc8c-zpm7r\" (UID: \"13a3bc95-6c08-450b-8a74-bc21330586f2\") " pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.125827 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.125740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:07.263468 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.263443 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c565dcc8c-zpm7r"] Jul 15 22:40:07.268995 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:40:07.268877 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a3bc95_6c08_450b_8a74_bc21330586f2.slice/crio-78843e0a4742e9964b2da6651d2a62e86b236871ab771761ff936119ccfbe610 WatchSource:0}: Error finding container 78843e0a4742e9964b2da6651d2a62e86b236871ab771761ff936119ccfbe610: Status 404 returned error can't find the container with id 78843e0a4742e9964b2da6651d2a62e86b236871ab771761ff936119ccfbe610 Jul 15 22:40:07.489382 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.489345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c565dcc8c-zpm7r" event={"ID":"13a3bc95-6c08-450b-8a74-bc21330586f2","Type":"ContainerStarted","Data":"05b619603eedebc89adcc7e72b57365f9aed41edb11ea53ff1c18aa44fffd8af"} Jul 15 22:40:07.489578 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:07.489395 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c565dcc8c-zpm7r" event={"ID":"13a3bc95-6c08-450b-8a74-bc21330586f2","Type":"ContainerStarted","Data":"78843e0a4742e9964b2da6651d2a62e86b236871ab771761ff936119ccfbe610"} Jul 15 22:40:17.125860 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:17.125822 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:17.126374 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:17.125880 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:17.130778 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:17.130752 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:17.161449 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:17.161387 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c565dcc8c-zpm7r" podStartSLOduration=11.161365422 podStartE2EDuration="11.161365422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:40:07.513346889 +0000 UTC m=+400.603998138" watchObservedRunningTime="2026-07-15 22:40:17.161365422 +0000 UTC m=+410.252016668" Jul 15 22:40:17.551062 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:17.551028 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c565dcc8c-zpm7r" Jul 15 22:40:20.628311 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.628276 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn"] Jul 15 22:40:20.630947 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.630927 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:20.634203 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.634178 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 22:40:20.635350 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.635328 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 22:40:20.635474 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.635362 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 22:40:20.635474 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.635440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mwdl7\"" Jul 15 22:40:20.643020 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.642996 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn"] Jul 15 22:40:20.744544 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.744501 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpdb\" (UniqueName: \"kubernetes.io/projected/912798a4-bd7e-4afe-b19c-23073dd97d6a-kube-api-access-grpdb\") pod \"dns-operator-controller-manager-864dd78c4c-wqrdn\" (UID: \"912798a4-bd7e-4afe-b19c-23073dd97d6a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:20.845894 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.845847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grpdb\" (UniqueName: \"kubernetes.io/projected/912798a4-bd7e-4afe-b19c-23073dd97d6a-kube-api-access-grpdb\") pod \"dns-operator-controller-manager-864dd78c4c-wqrdn\" (UID: \"912798a4-bd7e-4afe-b19c-23073dd97d6a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:20.857891 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.857855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpdb\" (UniqueName: \"kubernetes.io/projected/912798a4-bd7e-4afe-b19c-23073dd97d6a-kube-api-access-grpdb\") pod \"dns-operator-controller-manager-864dd78c4c-wqrdn\" (UID: \"912798a4-bd7e-4afe-b19c-23073dd97d6a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:20.942200 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:20.942111 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:21.087368 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:21.087335 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn"] Jul 15 22:40:21.089893 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:40:21.089859 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912798a4_bd7e_4afe_b19c_23073dd97d6a.slice/crio-ba7045c4197cd40ea9483773f5cef0ef4eeb0a906cba0834bd53b89328f6317b WatchSource:0}: Error finding container ba7045c4197cd40ea9483773f5cef0ef4eeb0a906cba0834bd53b89328f6317b: Status 404 returned error can't find the container with id ba7045c4197cd40ea9483773f5cef0ef4eeb0a906cba0834bd53b89328f6317b Jul 15 22:40:21.568214 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:21.568173 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" event={"ID":"912798a4-bd7e-4afe-b19c-23073dd97d6a","Type":"ContainerStarted","Data":"ba7045c4197cd40ea9483773f5cef0ef4eeb0a906cba0834bd53b89328f6317b"} Jul 15 22:40:23.580771 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:23.580675 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" event={"ID":"912798a4-bd7e-4afe-b19c-23073dd97d6a","Type":"ContainerStarted","Data":"22b2e395d24b1c07951edec14b20ec65522e1be3287706882ad16d1aa34150f1"} Jul 15 22:40:23.581171 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:23.580814 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:23.608882 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:23.608828 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" podStartSLOduration=1.470131121 podStartE2EDuration="3.6088095s" totalImagesPullingTime="2.138678379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:40:23.607332729 +0000 UTC m=+416.697984013" watchObservedRunningTime="2026-07-15 22:40:23.6088095 +0000 UTC m=+416.699460834" Jul 15 22:40:31.773496 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.773461 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw"] Jul 15 22:40:31.776206 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.776183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.779183 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.779152 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wt2v9\"" Jul 15 22:40:31.794539 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.794507 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw"] Jul 15 22:40:31.856312 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.856267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.856312 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.856320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkzc\" (UniqueName: \"kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.957014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.956978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.957014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.957015 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkzc\" (UniqueName: \"kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.957406 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.957383 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.963629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.963592 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw"] Jul 15 22:40:31.963960 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:40:31.963934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nmkzc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" Jul 15 22:40:31.968661 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.968622 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkzc\" (UniqueName: \"kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:31.971839 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:31.971808 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw"] Jul 15 22:40:32.006297 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.006248 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:32.008743 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.008721 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.032278 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.032193 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:32.158837 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.158794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc6ct\" (UniqueName: \"kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.159007 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.158861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.260361 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.260309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc6ct\" (UniqueName: \"kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.260535 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.260383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.260722 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.260706 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.270060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.270025 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc6ct\" (UniqueName: \"kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct\") pod \"kuadrant-operator-controller-manager-55467d9f7-hpxhl\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.320078 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.319985 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:32.466643 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.466617 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:32.469266 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:40:32.469238 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc71a5e_64e9_44ae_b1ae_b73cc11a69e4.slice/crio-f4f12e304f574f967ad9f31c2104f2d58589f68290d2b9f9bb0083bec64bc235 WatchSource:0}: Error finding container f4f12e304f574f967ad9f31c2104f2d58589f68290d2b9f9bb0083bec64bc235: Status 404 returned error can't find the container with id f4f12e304f574f967ad9f31c2104f2d58589f68290d2b9f9bb0083bec64bc235 Jul 15 22:40:32.628351 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.628271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:32.628499 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.628263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" event={"ID":"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4","Type":"ContainerStarted","Data":"f4f12e304f574f967ad9f31c2104f2d58589f68290d2b9f9bb0083bec64bc235"} Jul 15 22:40:32.630701 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:40:32.630668 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:32.635417 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.635393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:32.637770 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:40:32.637747 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:32.765570 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.765540 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmkzc\" (UniqueName: \"kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc\") pod \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " Jul 15 22:40:32.765751 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.765601 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume\") pod \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\" (UID: \"dbdb3bcf-32b4-4c97-be8c-4405182079ef\") " Jul 15 22:40:32.765946 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.765919 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dbdb3bcf-32b4-4c97-be8c-4405182079ef" (UID: "dbdb3bcf-32b4-4c97-be8c-4405182079ef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:32.767760 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.767734 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc" (OuterVolumeSpecName: "kube-api-access-nmkzc") pod "dbdb3bcf-32b4-4c97-be8c-4405182079ef" (UID: "dbdb3bcf-32b4-4c97-be8c-4405182079ef"). InnerVolumeSpecName "kube-api-access-nmkzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:32.867011 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.866968 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbdb3bcf-32b4-4c97-be8c-4405182079ef-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:40:32.867011 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:32.867003 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmkzc\" (UniqueName: \"kubernetes.io/projected/dbdb3bcf-32b4-4c97-be8c-4405182079ef-kube-api-access-nmkzc\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:40:33.407822 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:33.407754 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" path="/var/lib/kubelet/pods/dbdb3bcf-32b4-4c97-be8c-4405182079ef/volumes" Jul 15 22:40:33.633317 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:33.633285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:33.638392 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:40:33.638363 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:34.590090 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:34.590054 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wqrdn" Jul 15 22:40:34.612936 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:40:34.612883 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fb4xw\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="dbdb3bcf-32b4-4c97-be8c-4405182079ef" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fb4xw" Jul 15 22:40:37.661436 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:37.661333 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" event={"ID":"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4","Type":"ContainerStarted","Data":"35f19c64e0c85902b6ad6560a3d0d6a14255ce2e7d24cb69051186a3a095624f"} Jul 15 22:40:37.661436 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:37.661415 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:37.685717 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:37.685656 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" podStartSLOduration=1.812845064 podStartE2EDuration="6.685639395s" totalImagesPullingTime="4.872794331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:40:37.684297137 +0000 UTC m=+430.774948380" watchObservedRunningTime="2026-07-15 22:40:37.685639395 +0000 UTC m=+430.776290638" Jul 15 22:40:48.669428 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:48.669351 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:55.481621 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:55.481586 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:55.482090 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:55.481777 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" podUID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" containerName="manager" containerID="cri-o://35f19c64e0c85902b6ad6560a3d0d6a14255ce2e7d24cb69051186a3a095624f" gracePeriod=10 Jul 15 22:40:56.763092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.763050 2556 generic.go:356] "Generic (PLEG): container finished" podID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" containerID="35f19c64e0c85902b6ad6560a3d0d6a14255ce2e7d24cb69051186a3a095624f" exitCode=0 Jul 15 22:40:56.763562 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.763113 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" event={"ID":"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4","Type":"ContainerDied","Data":"35f19c64e0c85902b6ad6560a3d0d6a14255ce2e7d24cb69051186a3a095624f"} Jul 15 22:40:56.831961 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.831932 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:56.890064 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.890030 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc6ct\" (UniqueName: \"kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct\") pod \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " Jul 15 22:40:56.890241 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.890084 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume\") pod \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\" (UID: \"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4\") " Jul 15 22:40:56.890595 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.890570 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" (UID: "dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:40:56.892468 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.892441 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct" (OuterVolumeSpecName: "kube-api-access-qc6ct") pod "dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" (UID: "dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4"). InnerVolumeSpecName "kube-api-access-qc6ct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:40:56.991595 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.991557 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc6ct\" (UniqueName: \"kubernetes.io/projected/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-kube-api-access-qc6ct\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:40:56.991595 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:56.991594 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4-extensions-socket-volume\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:40:57.769188 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:57.769160 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" Jul 15 22:40:57.769588 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:57.769161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl" event={"ID":"dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4","Type":"ContainerDied","Data":"f4f12e304f574f967ad9f31c2104f2d58589f68290d2b9f9bb0083bec64bc235"} Jul 15 22:40:57.769588 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:57.769306 2556 scope.go:117] "RemoveContainer" containerID="35f19c64e0c85902b6ad6560a3d0d6a14255ce2e7d24cb69051186a3a095624f" Jul 15 22:40:57.790482 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:57.790446 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:57.794645 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:57.794621 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hpxhl"] Jul 15 22:40:59.407475 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:40:59.405211 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" path="/var/lib/kubelet/pods/dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4/volumes" Jul 15 22:41:14.347196 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.347154 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:14.347635 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.347594 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" containerName="manager" Jul 15 22:41:14.347635 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.347606 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" containerName="manager" Jul 15 22:41:14.347704 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.347684 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc71a5e-64e9-44ae-b1ae-b73cc11a69e4" containerName="manager" Jul 15 22:41:14.351508 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.351488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.354441 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.354419 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 22:41:14.354577 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.354450 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dm9m6\"" Jul 15 22:41:14.363413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.363390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:14.442355 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.442325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:14.449422 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.449385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzwq\" (UniqueName: \"kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.449584 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.449436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.550477 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.550428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzwq\" (UniqueName: \"kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.550477 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.550478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.551295 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.551265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.558195 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.558170 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzwq\" (UniqueName: \"kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq\") pod \"limitador-limitador-64c94fd64f-n4dvh\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.661762 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.661673 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:14.797936 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.797887 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:14.801259 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:14.801231 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47872df_615f_40a8_8a98_84f98b519346.slice/crio-e4ab8f54e8fd12166073d4529decab1298437fdd6f873ff8bd19772a12e985d4 WatchSource:0}: Error finding container e4ab8f54e8fd12166073d4529decab1298437fdd6f873ff8bd19772a12e985d4: Status 404 returned error can't find the container with id e4ab8f54e8fd12166073d4529decab1298437fdd6f873ff8bd19772a12e985d4 Jul 15 22:41:14.853386 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:14.853345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" event={"ID":"a47872df-615f-40a8-8a98-84f98b519346","Type":"ContainerStarted","Data":"e4ab8f54e8fd12166073d4529decab1298437fdd6f873ff8bd19772a12e985d4"} Jul 15 22:41:15.428932 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.428883 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:15.431253 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.431231 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:15.433688 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.433665 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ghtb\"" Jul 15 22:41:15.439799 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.439771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:15.559146 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.559108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4lm\" (UniqueName: \"kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm\") pod \"authorino-75d556bd77-4g7h5\" (UID: \"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca\") " pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:15.660915 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.660777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4lm\" (UniqueName: \"kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm\") pod \"authorino-75d556bd77-4g7h5\" (UID: \"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca\") " pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:15.675548 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.675514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4lm\" (UniqueName: \"kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm\") pod \"authorino-75d556bd77-4g7h5\" (UID: \"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca\") " pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:15.742097 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.742050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:15.919762 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:15.919732 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:15.922571 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:15.922532 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode50153eb_ed1f_4d21_a7bf_a85b0fec68ca.slice/crio-6e476df37e73f52a252690a65711d64bdcea252b0bf574f16a7f2041387b7597 WatchSource:0}: Error finding container 6e476df37e73f52a252690a65711d64bdcea252b0bf574f16a7f2041387b7597: Status 404 returned error can't find the container with id 6e476df37e73f52a252690a65711d64bdcea252b0bf574f16a7f2041387b7597 Jul 15 22:41:16.872699 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:16.872653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4g7h5" event={"ID":"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca","Type":"ContainerStarted","Data":"6e476df37e73f52a252690a65711d64bdcea252b0bf574f16a7f2041387b7597"} Jul 15 22:41:17.882560 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:17.882519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" event={"ID":"a47872df-615f-40a8-8a98-84f98b519346","Type":"ContainerStarted","Data":"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c"} Jul 15 22:41:17.883050 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:17.882604 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:17.901010 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:17.900938 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" podStartSLOduration=0.977724483 podStartE2EDuration="3.90089346s" totalImagesPullingTime="2.923168977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:17.899776541 +0000 UTC m=+470.990427785" watchObservedRunningTime="2026-07-15 22:41:17.90089346 +0000 UTC m=+470.991544704" Jul 15 22:41:19.894026 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:19.893993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4g7h5" event={"ID":"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca","Type":"ContainerStarted","Data":"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07"} Jul 15 22:41:19.910435 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:19.910364 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4g7h5" podStartSLOduration=1.037921016 podStartE2EDuration="4.910341705s" totalImagesPullingTime="3.872420689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:19.909240117 +0000 UTC m=+472.999891360" watchObservedRunningTime="2026-07-15 22:41:19.910341705 +0000 UTC m=+473.000992952" Jul 15 22:41:27.322936 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:27.322161 2556 scope.go:117] "RemoveContainer" containerID="b3353d85898550039c7a9af6d34a57df3b6bc26b02a30afd90ee5aff91b48e07" Jul 15 22:41:28.889281 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:28.889250 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:31.631971 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:31.631935 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:31.632419 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:31.632142 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" podUID="a47872df-615f-40a8-8a98-84f98b519346" containerName="limitador" containerID="cri-o://344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c" gracePeriod=30 Jul 15 22:41:32.587411 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.587381 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:32.732530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.732500 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file\") pod \"a47872df-615f-40a8-8a98-84f98b519346\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " Jul 15 22:41:32.732924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.732558 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdzwq\" (UniqueName: \"kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq\") pod \"a47872df-615f-40a8-8a98-84f98b519346\" (UID: \"a47872df-615f-40a8-8a98-84f98b519346\") " Jul 15 22:41:32.732924 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.732852 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file" (OuterVolumeSpecName: "config-file") pod "a47872df-615f-40a8-8a98-84f98b519346" (UID: "a47872df-615f-40a8-8a98-84f98b519346"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:41:32.734744 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.734717 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq" (OuterVolumeSpecName: "kube-api-access-jdzwq") pod "a47872df-615f-40a8-8a98-84f98b519346" (UID: "a47872df-615f-40a8-8a98-84f98b519346"). InnerVolumeSpecName "kube-api-access-jdzwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:41:32.833916 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.833858 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdzwq\" (UniqueName: \"kubernetes.io/projected/a47872df-615f-40a8-8a98-84f98b519346-kube-api-access-jdzwq\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:32.833916 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.833896 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a47872df-615f-40a8-8a98-84f98b519346-config-file\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:32.961107 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.961073 2556 generic.go:356] "Generic (PLEG): container finished" podID="a47872df-615f-40a8-8a98-84f98b519346" containerID="344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c" exitCode=0 Jul 15 22:41:32.961272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.961119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" event={"ID":"a47872df-615f-40a8-8a98-84f98b519346","Type":"ContainerDied","Data":"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c"} Jul 15 22:41:32.961272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.961190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" event={"ID":"a47872df-615f-40a8-8a98-84f98b519346","Type":"ContainerDied","Data":"e4ab8f54e8fd12166073d4529decab1298437fdd6f873ff8bd19772a12e985d4"} Jul 15 22:41:32.961272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.961122 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n4dvh" Jul 15 22:41:32.961272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.961213 2556 scope.go:117] "RemoveContainer" containerID="344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c" Jul 15 22:41:32.970308 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.970287 2556 scope.go:117] "RemoveContainer" containerID="344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c" Jul 15 22:41:32.970571 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:41:32.970550 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c\": container with ID starting with 344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c not found: ID does not exist" containerID="344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c" Jul 15 22:41:32.970645 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.970585 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c"} err="failed to get container status \"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c\": rpc error: code = NotFound desc = could not find container \"344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c\": container with ID starting with 344e3e9d6fbc62d7334993e2eea161326dbbe01236824bfd5d59a08ccd66521c not found: ID does not exist" Jul 15 22:41:32.982758 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.982688 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:32.988821 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:32.988792 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n4dvh"] Jul 15 22:41:33.404074 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:33.403993 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47872df-615f-40a8-8a98-84f98b519346" path="/var/lib/kubelet/pods/a47872df-615f-40a8-8a98-84f98b519346/volumes" Jul 15 22:41:35.860440 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.860404 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc"] Jul 15 22:41:35.860812 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.860781 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47872df-615f-40a8-8a98-84f98b519346" containerName="limitador" Jul 15 22:41:35.860812 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.860792 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47872df-615f-40a8-8a98-84f98b519346" containerName="limitador" Jul 15 22:41:35.860879 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.860861 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47872df-615f-40a8-8a98-84f98b519346" containerName="limitador" Jul 15 22:41:35.865536 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.865512 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:35.868600 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.868575 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5rtsk\"" Jul 15 22:41:35.868864 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.868847 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 22:41:35.869876 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.869850 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 22:41:35.870121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.869872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 22:41:35.877830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.877803 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc"] Jul 15 22:41:35.959228 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.959196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04ad6c88-59dc-445b-9e6f-db01eb2292b5-data\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:35.959403 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:35.959240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwb4\" (UniqueName: \"kubernetes.io/projected/04ad6c88-59dc-445b-9e6f-db01eb2292b5-kube-api-access-nzwb4\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.060203 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.060154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04ad6c88-59dc-445b-9e6f-db01eb2292b5-data\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.060413 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.060218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwb4\" (UniqueName: \"kubernetes.io/projected/04ad6c88-59dc-445b-9e6f-db01eb2292b5-kube-api-access-nzwb4\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.060550 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.060529 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/04ad6c88-59dc-445b-9e6f-db01eb2292b5-data\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.072481 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.072455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwb4\" (UniqueName: \"kubernetes.io/projected/04ad6c88-59dc-445b-9e6f-db01eb2292b5-kube-api-access-nzwb4\") pod \"postgres-69fb4594cf-tx7fc\" (UID: \"04ad6c88-59dc-445b-9e6f-db01eb2292b5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.178757 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.178671 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:36.324436 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.324341 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc"] Jul 15 22:41:36.326872 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:36.326841 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ad6c88_59dc_445b_9e6f_db01eb2292b5.slice/crio-b6634cc440075e1ec4181b34f67724d7d75b2b42c4bc62a91dadee62ec2adfcb WatchSource:0}: Error finding container b6634cc440075e1ec4181b34f67724d7d75b2b42c4bc62a91dadee62ec2adfcb: Status 404 returned error can't find the container with id b6634cc440075e1ec4181b34f67724d7d75b2b42c4bc62a91dadee62ec2adfcb Jul 15 22:41:36.984526 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:36.984484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" event={"ID":"04ad6c88-59dc-445b-9e6f-db01eb2292b5","Type":"ContainerStarted","Data":"b6634cc440075e1ec4181b34f67724d7d75b2b42c4bc62a91dadee62ec2adfcb"} Jul 15 22:41:42.015077 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:42.015039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" event={"ID":"04ad6c88-59dc-445b-9e6f-db01eb2292b5","Type":"ContainerStarted","Data":"8ec6d53df33e5b87d9372a19d45947dde051776cb7a28b141a3f3d600547215f"} Jul 15 22:41:42.015483 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:42.015195 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:42.044394 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:42.044345 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" podStartSLOduration=2.248700499 podStartE2EDuration="7.044326985s" totalImagesPullingTime="4.795626486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:42.043925745 +0000 UTC m=+495.134576992" watchObservedRunningTime="2026-07-15 22:41:42.044326985 +0000 UTC m=+495.134978229" Jul 15 22:41:48.050070 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.050038 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tx7fc" Jul 15 22:41:48.593578 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.593539 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:48.597783 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.597758 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:48.608982 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.608949 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:48.660350 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.660305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc2ng\" (UniqueName: \"kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng\") pod \"authorino-5d4b67c446-pf8gl\" (UID: \"bc8dc278-a52b-41f1-9b86-37a96499a24f\") " pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:48.761080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.761033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc2ng\" (UniqueName: \"kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng\") pod \"authorino-5d4b67c446-pf8gl\" (UID: \"bc8dc278-a52b-41f1-9b86-37a96499a24f\") " pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:48.770537 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.770498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc2ng\" (UniqueName: \"kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng\") pod \"authorino-5d4b67c446-pf8gl\" (UID: \"bc8dc278-a52b-41f1-9b86-37a96499a24f\") " pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:48.800719 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.800687 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:48.801011 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.800997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:48.826651 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.826622 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-mwtm9"] Jul 15 22:41:48.830371 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.830344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.833041 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.833018 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 22:41:48.838753 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.838719 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-mwtm9"] Jul 15 22:41:48.862487 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.862456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.862617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.862598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csqxm\" (UniqueName: \"kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.868356 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.868327 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mwtm9"] Jul 15 22:41:48.868761 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:41:48.868726 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-csqxm tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-mwtm9" podUID="3e270a38-5483-4aa7-818f-f228ecedfc47" Jul 15 22:41:48.905929 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.897671 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:41:48.913443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.913413 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:41:48.913599 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.913510 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:48.952185 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.952162 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:48.954734 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:48.954710 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc8dc278_a52b_41f1_9b86_37a96499a24f.slice/crio-efc350f40773d6d16f26ca28ff1169b311a46806a773ec692dd5803811e84ed2 WatchSource:0}: Error finding container efc350f40773d6d16f26ca28ff1169b311a46806a773ec692dd5803811e84ed2: Status 404 returned error can't find the container with id efc350f40773d6d16f26ca28ff1169b311a46806a773ec692dd5803811e84ed2 Jul 15 22:41:48.963398 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.963372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csqxm\" (UniqueName: \"kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.963502 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.963412 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:48.963502 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.963456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.963502 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.963479 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2blxs\" (UniqueName: \"kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:48.966028 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.966000 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:48.972221 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:48.972191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csqxm\" (UniqueName: \"kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm\") pod \"authorino-76877994-mwtm9\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:49.048552 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.048516 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" event={"ID":"bc8dc278-a52b-41f1-9b86-37a96499a24f","Type":"ContainerStarted","Data":"efc350f40773d6d16f26ca28ff1169b311a46806a773ec692dd5803811e84ed2"} Jul 15 22:41:49.048738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.048580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:49.056063 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.056039 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:49.064104 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.064039 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csqxm\" (UniqueName: \"kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm\") pod \"3e270a38-5483-4aa7-818f-f228ecedfc47\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " Jul 15 22:41:49.064321 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.064116 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert\") pod \"3e270a38-5483-4aa7-818f-f228ecedfc47\" (UID: \"3e270a38-5483-4aa7-818f-f228ecedfc47\") " Jul 15 22:41:49.064321 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.064251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2blxs\" (UniqueName: \"kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:49.064514 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.064343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:49.066624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.066598 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm" (OuterVolumeSpecName: "kube-api-access-csqxm") pod "3e270a38-5483-4aa7-818f-f228ecedfc47" (UID: "3e270a38-5483-4aa7-818f-f228ecedfc47"). InnerVolumeSpecName "kube-api-access-csqxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:41:49.066624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.066611 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3e270a38-5483-4aa7-818f-f228ecedfc47" (UID: "3e270a38-5483-4aa7-818f-f228ecedfc47"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:41:49.066987 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.066971 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:49.072279 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.072261 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2blxs\" (UniqueName: \"kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs\") pod \"authorino-f5f5d664c-6pcrs\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:49.165110 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.165027 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csqxm\" (UniqueName: \"kubernetes.io/projected/3e270a38-5483-4aa7-818f-f228ecedfc47-kube-api-access-csqxm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:49.165110 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.165057 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e270a38-5483-4aa7-818f-f228ecedfc47-tls-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:49.224229 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.224193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:41:49.358444 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:49.358410 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:41:49.360995 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:49.360968 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa2b7472_caed_4e88_94f4_c830983cd6be.slice/crio-f46ad4741ddd51303a69d76535692ad5ba81b10330cc8479dccbd467dc83b354 WatchSource:0}: Error finding container f46ad4741ddd51303a69d76535692ad5ba81b10330cc8479dccbd467dc83b354: Status 404 returned error can't find the container with id f46ad4741ddd51303a69d76535692ad5ba81b10330cc8479dccbd467dc83b354 Jul 15 22:41:50.054548 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.054448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" event={"ID":"bc8dc278-a52b-41f1-9b86-37a96499a24f","Type":"ContainerStarted","Data":"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c"} Jul 15 22:41:50.054745 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.054529 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" podUID="bc8dc278-a52b-41f1-9b86-37a96499a24f" containerName="authorino" containerID="cri-o://9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c" gracePeriod=30 Jul 15 22:41:50.056080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.056047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" event={"ID":"aa2b7472-caed-4e88-94f4-c830983cd6be","Type":"ContainerStarted","Data":"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024"} Jul 15 22:41:50.056080 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.056079 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" event={"ID":"aa2b7472-caed-4e88-94f4-c830983cd6be","Type":"ContainerStarted","Data":"f46ad4741ddd51303a69d76535692ad5ba81b10330cc8479dccbd467dc83b354"} Jul 15 22:41:50.056541 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.056161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mwtm9" Jul 15 22:41:50.072934 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.072866 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" podStartSLOduration=1.194097489 podStartE2EDuration="2.072848642s" totalImagesPullingTime="878.751153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:50.070967919 +0000 UTC m=+503.161619162" watchObservedRunningTime="2026-07-15 22:41:50.072848642 +0000 UTC m=+503.163499885" Jul 15 22:41:50.089527 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.089471 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" podStartSLOduration=1.601388809 podStartE2EDuration="2.089453588s" totalImagesPullingTime="488.064779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:50.087989974 +0000 UTC m=+503.178641219" watchObservedRunningTime="2026-07-15 22:41:50.089453588 +0000 UTC m=+503.180104832" Jul 15 22:41:50.115095 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.115056 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mwtm9"] Jul 15 22:41:50.122714 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.122659 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:50.122928 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.122882 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4g7h5" podUID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" containerName="authorino" containerID="cri-o://7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07" gracePeriod=30 Jul 15 22:41:50.125580 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.125544 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-mwtm9"] Jul 15 22:41:50.386441 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.386404 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:50.395620 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.395598 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:50.479789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.479751 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr4lm\" (UniqueName: \"kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm\") pod \"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca\" (UID: \"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca\") " Jul 15 22:41:50.479989 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.479831 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc2ng\" (UniqueName: \"kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng\") pod \"bc8dc278-a52b-41f1-9b86-37a96499a24f\" (UID: \"bc8dc278-a52b-41f1-9b86-37a96499a24f\") " Jul 15 22:41:50.481932 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.481881 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm" (OuterVolumeSpecName: "kube-api-access-fr4lm") pod "e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" (UID: "e50153eb-ed1f-4d21-a7bf-a85b0fec68ca"). InnerVolumeSpecName "kube-api-access-fr4lm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:41:50.482040 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.482003 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng" (OuterVolumeSpecName: "kube-api-access-hc2ng") pod "bc8dc278-a52b-41f1-9b86-37a96499a24f" (UID: "bc8dc278-a52b-41f1-9b86-37a96499a24f"). InnerVolumeSpecName "kube-api-access-hc2ng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:41:50.580615 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.580523 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr4lm\" (UniqueName: \"kubernetes.io/projected/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca-kube-api-access-fr4lm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:50.580615 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:50.580554 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc2ng\" (UniqueName: \"kubernetes.io/projected/bc8dc278-a52b-41f1-9b86-37a96499a24f-kube-api-access-hc2ng\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:41:51.062195 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.062161 2556 generic.go:356] "Generic (PLEG): container finished" podID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" containerID="7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07" exitCode=0 Jul 15 22:41:51.062650 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.062205 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4g7h5" Jul 15 22:41:51.062650 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.062238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4g7h5" event={"ID":"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca","Type":"ContainerDied","Data":"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07"} Jul 15 22:41:51.062650 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.062275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4g7h5" event={"ID":"e50153eb-ed1f-4d21-a7bf-a85b0fec68ca","Type":"ContainerDied","Data":"6e476df37e73f52a252690a65711d64bdcea252b0bf574f16a7f2041387b7597"} Jul 15 22:41:51.062650 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.062291 2556 scope.go:117] "RemoveContainer" containerID="7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07" Jul 15 22:41:51.063624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.063501 2556 generic.go:356] "Generic (PLEG): container finished" podID="bc8dc278-a52b-41f1-9b86-37a96499a24f" containerID="9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c" exitCode=0 Jul 15 22:41:51.063624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.063532 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" event={"ID":"bc8dc278-a52b-41f1-9b86-37a96499a24f","Type":"ContainerDied","Data":"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c"} Jul 15 22:41:51.063624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.063548 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" Jul 15 22:41:51.063624 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.063578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pf8gl" event={"ID":"bc8dc278-a52b-41f1-9b86-37a96499a24f","Type":"ContainerDied","Data":"efc350f40773d6d16f26ca28ff1169b311a46806a773ec692dd5803811e84ed2"} Jul 15 22:41:51.071442 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.071410 2556 scope.go:117] "RemoveContainer" containerID="7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07" Jul 15 22:41:51.071711 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:41:51.071687 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07\": container with ID starting with 7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07 not found: ID does not exist" containerID="7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07" Jul 15 22:41:51.071813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.071723 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07"} err="failed to get container status \"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07\": rpc error: code = NotFound desc = could not find container \"7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07\": container with ID starting with 7a83c955c3417c5be08eafc93f1630249df5d99fb3932257b4034b8253e9ff07 not found: ID does not exist" Jul 15 22:41:51.071813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.071745 2556 scope.go:117] "RemoveContainer" containerID="9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c" Jul 15 22:41:51.079849 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.079832 2556 scope.go:117] "RemoveContainer" containerID="9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c" Jul 15 22:41:51.080134 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:41:51.080116 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c\": container with ID starting with 9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c not found: ID does not exist" containerID="9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c" Jul 15 22:41:51.080189 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.080143 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c"} err="failed to get container status \"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c\": rpc error: code = NotFound desc = could not find container \"9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c\": container with ID starting with 9842127502d71867aeeedb31c4553f8f2950198d1417974c30921861c7ccdd9c not found: ID does not exist" Jul 15 22:41:51.087229 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.087203 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:51.092858 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.092834 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4g7h5"] Jul 15 22:41:51.104093 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.104066 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:51.107190 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.107170 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pf8gl"] Jul 15 22:41:51.404857 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.404773 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e270a38-5483-4aa7-818f-f228ecedfc47" path="/var/lib/kubelet/pods/3e270a38-5483-4aa7-818f-f228ecedfc47/volumes" Jul 15 22:41:51.405050 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.405036 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc8dc278-a52b-41f1-9b86-37a96499a24f" path="/var/lib/kubelet/pods/bc8dc278-a52b-41f1-9b86-37a96499a24f/volumes" Jul 15 22:41:51.405331 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:51.405319 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" path="/var/lib/kubelet/pods/e50153eb-ed1f-4d21-a7bf-a85b0fec68ca/volumes" Jul 15 22:41:54.705038 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.704997 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:41:54.705571 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705550 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" containerName="authorino" Jul 15 22:41:54.705660 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705575 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" containerName="authorino" Jul 15 22:41:54.705660 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705615 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc8dc278-a52b-41f1-9b86-37a96499a24f" containerName="authorino" Jul 15 22:41:54.705660 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705624 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc8dc278-a52b-41f1-9b86-37a96499a24f" containerName="authorino" Jul 15 22:41:54.705798 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705746 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50153eb-ed1f-4d21-a7bf-a85b0fec68ca" containerName="authorino" Jul 15 22:41:54.705798 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.705761 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc8dc278-a52b-41f1-9b86-37a96499a24f" containerName="authorino" Jul 15 22:41:54.711165 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.711139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.713855 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.713830 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 22:41:54.714036 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.713858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 22:41:54.714036 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.713998 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p6pv7\"" Jul 15 22:41:54.717731 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.717691 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:41:54.820028 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.819987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt8nx\" (UniqueName: \"kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.820028 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.820030 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.864501 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.864461 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:41:54.867184 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.867160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:54.878259 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.878230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:41:54.921133 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.921087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:54.921133 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.921130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjzqv\" (UniqueName: \"kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:54.921361 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.921210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt8nx\" (UniqueName: \"kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.921361 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.921239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.924032 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.924005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:54.929851 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:54.929827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt8nx\" (UniqueName: \"kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx\") pod \"maas-controller-55b59f554-btvl9\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:55.021949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.021884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:55.021949 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.021956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjzqv\" (UniqueName: \"kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:55.023425 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.023404 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:55.024499 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.024481 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:55.030808 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.030777 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjzqv\" (UniqueName: \"kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv\") pod \"maas-controller-6986b46494-qz6n8\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:55.164816 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.164791 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:41:55.167220 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:55.167189 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1367f33d_d9b6_421e_a014_f3268c0c0c17.slice/crio-c3302246ce2b4147f3330b03b645302d17a212e04f894d11072d1b8a7d0d9265 WatchSource:0}: Error finding container c3302246ce2b4147f3330b03b645302d17a212e04f894d11072d1b8a7d0d9265: Status 404 returned error can't find the container with id c3302246ce2b4147f3330b03b645302d17a212e04f894d11072d1b8a7d0d9265 Jul 15 22:41:55.179264 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.179235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:55.312934 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:55.312725 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:41:55.315500 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:41:55.315472 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ed1930_dfa1_45cf_8002_5a0a56444392.slice/crio-36f2d8335b02cc848178c7a0ab0d70b573dfc67c1b6c868b5b879a250383ff50 WatchSource:0}: Error finding container 36f2d8335b02cc848178c7a0ab0d70b573dfc67c1b6c868b5b879a250383ff50: Status 404 returned error can't find the container with id 36f2d8335b02cc848178c7a0ab0d70b573dfc67c1b6c868b5b879a250383ff50 Jul 15 22:41:56.098565 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:56.098511 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b59f554-btvl9" event={"ID":"1367f33d-d9b6-421e-a014-f3268c0c0c17","Type":"ContainerStarted","Data":"c3302246ce2b4147f3330b03b645302d17a212e04f894d11072d1b8a7d0d9265"} Jul 15 22:41:56.100458 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:56.100396 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-qz6n8" event={"ID":"e1ed1930-dfa1-45cf-8002-5a0a56444392","Type":"ContainerStarted","Data":"36f2d8335b02cc848178c7a0ab0d70b573dfc67c1b6c868b5b879a250383ff50"} Jul 15 22:41:58.113025 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.112891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b59f554-btvl9" event={"ID":"1367f33d-d9b6-421e-a014-f3268c0c0c17","Type":"ContainerStarted","Data":"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f"} Jul 15 22:41:58.113446 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.113027 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:41:58.114549 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.114524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-qz6n8" event={"ID":"e1ed1930-dfa1-45cf-8002-5a0a56444392","Type":"ContainerStarted","Data":"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47"} Jul 15 22:41:58.114672 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.114616 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:41:58.152410 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.152346 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b59f554-btvl9" podStartSLOduration=1.588236727 podStartE2EDuration="4.152324209s" totalImagesPullingTime="2.564087482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:58.149039931 +0000 UTC m=+511.239691174" watchObservedRunningTime="2026-07-15 22:41:58.152324209 +0000 UTC m=+511.242975454" Jul 15 22:41:58.188666 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:41:58.188600 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6986b46494-qz6n8" podStartSLOduration=1.762986598 podStartE2EDuration="4.188579048s" totalImagesPullingTime="2.42559245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:58.182322911 +0000 UTC m=+511.272974155" watchObservedRunningTime="2026-07-15 22:41:58.188579048 +0000 UTC m=+511.279230291" Jul 15 22:42:09.125262 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.125222 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:42:09.125675 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.125292 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:42:09.183845 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.183807 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:42:09.184117 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.184050 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55b59f554-btvl9" podUID="1367f33d-d9b6-421e-a014-f3268c0c0c17" containerName="manager" containerID="cri-o://6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f" gracePeriod=30 Jul 15 22:42:09.437196 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.437169 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:42:09.559341 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.559281 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt8nx\" (UniqueName: \"kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx\") pod \"1367f33d-d9b6-421e-a014-f3268c0c0c17\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " Jul 15 22:42:09.559543 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.559408 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert\") pod \"1367f33d-d9b6-421e-a014-f3268c0c0c17\" (UID: \"1367f33d-d9b6-421e-a014-f3268c0c0c17\") " Jul 15 22:42:09.561729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.561690 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1367f33d-d9b6-421e-a014-f3268c0c0c17" (UID: "1367f33d-d9b6-421e-a014-f3268c0c0c17"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:42:09.561729 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.561712 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx" (OuterVolumeSpecName: "kube-api-access-lt8nx") pod "1367f33d-d9b6-421e-a014-f3268c0c0c17" (UID: "1367f33d-d9b6-421e-a014-f3268c0c0c17"). InnerVolumeSpecName "kube-api-access-lt8nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:42:09.660276 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.660237 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1367f33d-d9b6-421e-a014-f3268c0c0c17-webhook-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:42:09.660276 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:09.660271 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt8nx\" (UniqueName: \"kubernetes.io/projected/1367f33d-d9b6-421e-a014-f3268c0c0c17-kube-api-access-lt8nx\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:42:10.181217 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.181185 2556 generic.go:356] "Generic (PLEG): container finished" podID="1367f33d-d9b6-421e-a014-f3268c0c0c17" containerID="6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f" exitCode=0 Jul 15 22:42:10.181639 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.181233 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b59f554-btvl9" Jul 15 22:42:10.181639 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.181245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b59f554-btvl9" event={"ID":"1367f33d-d9b6-421e-a014-f3268c0c0c17","Type":"ContainerDied","Data":"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f"} Jul 15 22:42:10.181639 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.181287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b59f554-btvl9" event={"ID":"1367f33d-d9b6-421e-a014-f3268c0c0c17","Type":"ContainerDied","Data":"c3302246ce2b4147f3330b03b645302d17a212e04f894d11072d1b8a7d0d9265"} Jul 15 22:42:10.181639 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.181308 2556 scope.go:117] "RemoveContainer" containerID="6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f" Jul 15 22:42:10.190306 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.190139 2556 scope.go:117] "RemoveContainer" containerID="6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f" Jul 15 22:42:10.190438 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:42:10.190412 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f\": container with ID starting with 6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f not found: ID does not exist" containerID="6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f" Jul 15 22:42:10.190483 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.190447 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f"} err="failed to get container status \"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f\": rpc error: code = NotFound desc = could not find container \"6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f\": container with ID starting with 6ae8645ef3a3d01b12f8cedd16bcefc826eab280f9870c5cc9afb8f9f3559c1f not found: ID does not exist" Jul 15 22:42:10.203344 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.203315 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:42:10.207178 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:10.207151 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55b59f554-btvl9"] Jul 15 22:42:11.404279 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:11.404239 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1367f33d-d9b6-421e-a014-f3268c0c0c17" path="/var/lib/kubelet/pods/1367f33d-d9b6-421e-a014-f3268c0c0c17/volumes" Jul 15 22:42:29.458323 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.458284 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x"] Jul 15 22:42:29.458717 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.458697 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1367f33d-d9b6-421e-a014-f3268c0c0c17" containerName="manager" Jul 15 22:42:29.458717 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.458709 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1367f33d-d9b6-421e-a014-f3268c0c0c17" containerName="manager" Jul 15 22:42:29.458789 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.458766 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1367f33d-d9b6-421e-a014-f3268c0c0c17" containerName="manager" Jul 15 22:42:29.463194 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.463176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.467095 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.467072 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 22:42:29.467230 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.467077 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bb4dr\"" Jul 15 22:42:29.476947 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.476923 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x"] Jul 15 22:42:29.540474 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.540436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-openshift-service-ca\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.540647 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.540570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-maas-api-tls\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.540647 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.540597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czvs\" (UniqueName: \"kubernetes.io/projected/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-kube-api-access-2czvs\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.641705 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.641662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-openshift-service-ca\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.641870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.641770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-maas-api-tls\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.641870 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.641787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czvs\" (UniqueName: \"kubernetes.io/projected/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-kube-api-access-2czvs\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.642360 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.642339 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-openshift-service-ca\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.644257 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.644234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-maas-api-tls\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.653706 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.653679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czvs\" (UniqueName: \"kubernetes.io/projected/6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e-kube-api-access-2czvs\") pod \"maas-api-8548fc8f44-qvz4x\" (UID: \"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e\") " pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.774177 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.774095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:29.929121 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:29.929086 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x"] Jul 15 22:42:29.932429 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:42:29.932392 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6f6d72_ec6d_4da6_9aa4_5aea08dc2a2e.slice/crio-4148a53910a133ef6af0b4093815bb008068318f150dae7aeb32a647ea938664 WatchSource:0}: Error finding container 4148a53910a133ef6af0b4093815bb008068318f150dae7aeb32a647ea938664: Status 404 returned error can't find the container with id 4148a53910a133ef6af0b4093815bb008068318f150dae7aeb32a647ea938664 Jul 15 22:42:30.121998 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.121884 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v4xld"] Jul 15 22:42:30.125325 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.125296 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.128880 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.128851 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9swh2\"" Jul 15 22:42:30.129069 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.129037 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 22:42:30.137689 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.137660 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v4xld"] Jul 15 22:42:30.146692 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.146659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvd5\" (UniqueName: \"kubernetes.io/projected/57b430ac-20b5-4496-ad66-870c48ee3570-kube-api-access-6tvd5\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.146864 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.146725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b430ac-20b5-4496-ad66-870c48ee3570-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.198957 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.198914 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q9g24"] Jul 15 22:42:30.201815 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.201794 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.214853 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.214820 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q9g24"] Jul 15 22:42:30.248272 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.248226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvd5\" (UniqueName: \"kubernetes.io/projected/57b430ac-20b5-4496-ad66-870c48ee3570-kube-api-access-6tvd5\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.248476 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.248312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b430ac-20b5-4496-ad66-870c48ee3570-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.248476 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.248343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2znbq\" (UniqueName: \"kubernetes.io/projected/b6cef660-2539-4188-aaa0-dda5585135bc-kube-api-access-2znbq\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.248476 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.248372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6cef660-2539-4188-aaa0-dda5585135bc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.249094 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.249073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b430ac-20b5-4496-ad66-870c48ee3570-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.259125 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.259096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvd5\" (UniqueName: \"kubernetes.io/projected/57b430ac-20b5-4496-ad66-870c48ee3570-kube-api-access-6tvd5\") pod \"payload-pre-processing-74584bb9f8-v4xld\" (UID: \"57b430ac-20b5-4496-ad66-870c48ee3570\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.293953 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.293870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" event={"ID":"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e","Type":"ContainerStarted","Data":"4148a53910a133ef6af0b4093815bb008068318f150dae7aeb32a647ea938664"} Jul 15 22:42:30.349534 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.349490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6cef660-2539-4188-aaa0-dda5585135bc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.349710 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.349664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znbq\" (UniqueName: \"kubernetes.io/projected/b6cef660-2539-4188-aaa0-dda5585135bc-kube-api-access-2znbq\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.350387 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.350365 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6cef660-2539-4188-aaa0-dda5585135bc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.361384 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.361347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2znbq\" (UniqueName: \"kubernetes.io/projected/b6cef660-2539-4188-aaa0-dda5585135bc-kube-api-access-2znbq\") pod \"payload-processing-f9b8d9b9b-q9g24\" (UID: \"b6cef660-2539-4188-aaa0-dda5585135bc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.437849 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.437743 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:30.513093 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.513052 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:30.615562 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.615530 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v4xld"] Jul 15 22:42:30.702096 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:30.701874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q9g24"] Jul 15 22:42:30.705202 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:42:30.705167 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cef660_2539_4188_aaa0_dda5585135bc.slice/crio-b41da48cadcafe9f63c678e0e49334647c9a61d7307a37bfed65387dc3baa0a5 WatchSource:0}: Error finding container b41da48cadcafe9f63c678e0e49334647c9a61d7307a37bfed65387dc3baa0a5: Status 404 returned error can't find the container with id b41da48cadcafe9f63c678e0e49334647c9a61d7307a37bfed65387dc3baa0a5 Jul 15 22:42:31.301651 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:31.301607 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" event={"ID":"b6cef660-2539-4188-aaa0-dda5585135bc","Type":"ContainerStarted","Data":"b41da48cadcafe9f63c678e0e49334647c9a61d7307a37bfed65387dc3baa0a5"} Jul 15 22:42:31.302974 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:31.302940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" event={"ID":"57b430ac-20b5-4496-ad66-870c48ee3570","Type":"ContainerStarted","Data":"bd6dd885e28f72648cf23ceca2075f9859f3777343d35e5c049f2ca535685b01"} Jul 15 22:42:32.310169 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:32.310134 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" event={"ID":"6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e","Type":"ContainerStarted","Data":"07bd808ae208f60db2c318cd1781f877da223bb0a03a3b70ab78de4a8f01a216"} Jul 15 22:42:32.310571 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:32.310285 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:32.326805 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:32.326745 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" podStartSLOduration=1.892549207 podStartE2EDuration="3.32672451s" totalImagesPullingTime="1.434175303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:32.325399547 +0000 UTC m=+545.416050790" watchObservedRunningTime="2026-07-15 22:42:32.32672451 +0000 UTC m=+545.417375755" Jul 15 22:42:33.317557 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:33.317506 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" event={"ID":"57b430ac-20b5-4496-ad66-870c48ee3570","Type":"ContainerStarted","Data":"a51391e6ad12b8c9ff7a0c8da261d87450a0593716f47e0f6b353f66cc4b3f41"} Jul 15 22:42:33.318014 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:33.317585 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:33.319158 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:33.319134 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" event={"ID":"b6cef660-2539-4188-aaa0-dda5585135bc","Type":"ContainerStarted","Data":"7519bd17c970292c6699af9a77b7a6ab5aadc5ea7cc51c5427ca2b763a4cd683"} Jul 15 22:42:33.334811 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:33.334760 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" podStartSLOduration=1.629928761 podStartE2EDuration="3.334737639s" totalImagesPullingTime="1.704808878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:33.333522743 +0000 UTC m=+546.424173987" watchObservedRunningTime="2026-07-15 22:42:33.334737639 +0000 UTC m=+546.425388883" Jul 15 22:42:33.355113 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:33.355058 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" podStartSLOduration=1.731761781 podStartE2EDuration="3.355041387s" totalImagesPullingTime="1.623279606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:33.353862959 +0000 UTC m=+546.444514203" watchObservedRunningTime="2026-07-15 22:42:33.355041387 +0000 UTC m=+546.445692631" Jul 15 22:42:34.324735 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:34.324697 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:42:38.324835 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:38.324802 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8548fc8f44-qvz4x" Jul 15 22:42:44.326862 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:44.326833 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v4xld" Jul 15 22:42:45.331934 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:42:45.331874 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-q9g24" Jul 15 22:43:09.264629 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.264594 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr"] Jul 15 22:43:09.269597 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.269572 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.275617 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.275596 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d7k42\"" Jul 15 22:43:09.275770 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.275600 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 22:43:09.275770 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.275688 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 22:43:09.275896 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.275770 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 22:43:09.281480 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.281461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr"] Jul 15 22:43:09.319737 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.319917 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkcjk\" (UniqueName: \"kubernetes.io/projected/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-kube-api-access-vkcjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.319917 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319823 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.319917 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.320023 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.320023 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.319969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.420925 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.420869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421112 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.420973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421112 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkcjk\" (UniqueName: \"kubernetes.io/projected/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-kube-api-access-vkcjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421439 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421416 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421512 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421457 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.421712 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.421696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.423320 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.423297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.423802 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.423775 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.429897 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.429875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkcjk\" (UniqueName: \"kubernetes.io/projected/09d7ede3-ec0e-48b8-95da-fe20ba6a66b3-kube-api-access-vkcjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vmfr\" (UID: \"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.581165 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.581076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:09.722024 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:09.721984 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr"] Jul 15 22:43:09.724465 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:43:09.724435 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d7ede3_ec0e_48b8_95da_fe20ba6a66b3.slice/crio-5a94bb76dfc67cdbc93d029490b21c5dcf2bcbed94ca58b4b54b2c4775be3793 WatchSource:0}: Error finding container 5a94bb76dfc67cdbc93d029490b21c5dcf2bcbed94ca58b4b54b2c4775be3793: Status 404 returned error can't find the container with id 5a94bb76dfc67cdbc93d029490b21c5dcf2bcbed94ca58b4b54b2c4775be3793 Jul 15 22:43:10.525593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:10.525548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" event={"ID":"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3","Type":"ContainerStarted","Data":"5a94bb76dfc67cdbc93d029490b21c5dcf2bcbed94ca58b4b54b2c4775be3793"} Jul 15 22:43:11.532243 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:11.532196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" event={"ID":"09d7ede3-ec0e-48b8-95da-fe20ba6a66b3","Type":"ContainerStarted","Data":"3e0284096173af2b887246be7805e08690778c9bdb725b0dfd8ec916094463d6"} Jul 15 22:43:11.551473 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:11.551419 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" podStartSLOduration=1.421716366 podStartE2EDuration="2.551400122s" totalImagesPullingTime="1.129683756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:11.549023964 +0000 UTC m=+584.639675206" watchObservedRunningTime="2026-07-15 22:43:11.551400122 +0000 UTC m=+584.642051365" Jul 15 22:43:19.582183 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:19.582147 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:19.582579 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:19.582220 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:19.594942 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:19.594895 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:20.591797 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:20.591764 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vmfr" Jul 15 22:43:27.332790 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:27.332758 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:43:27.333222 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:27.333010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:43:47.964616 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:47.964537 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq"] Jul 15 22:43:47.970577 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:47.970555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:47.973180 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:47.973157 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 22:43:47.978147 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:47.978120 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq"] Jul 15 22:43:48.005620 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2glr\" (UniqueName: \"kubernetes.io/projected/07a3455b-c9f0-4371-ac51-4cae2a176a9c-kube-api-access-p2glr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.005780 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.005780 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.005780 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.005885 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.005885 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.005825 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.106590 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.106787 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.106787 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106639 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.106787 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2glr\" (UniqueName: \"kubernetes.io/projected/07a3455b-c9f0-4371-ac51-4cae2a176a9c-kube-api-access-p2glr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.106787 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.107007 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.107007 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.106939 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.107088 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.107002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.107237 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.107218 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.109108 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.109084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07a3455b-c9f0-4371-ac51-4cae2a176a9c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.109530 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.109511 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07a3455b-c9f0-4371-ac51-4cae2a176a9c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.115728 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.115705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2glr\" (UniqueName: \"kubernetes.io/projected/07a3455b-c9f0-4371-ac51-4cae2a176a9c-kube-api-access-p2glr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8mwkq\" (UID: \"07a3455b-c9f0-4371-ac51-4cae2a176a9c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.282357 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.282262 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:48.446772 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.446747 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq"] Jul 15 22:43:48.449288 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:43:48.449258 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a3455b_c9f0_4371_ac51_4cae2a176a9c.slice/crio-caf51fc21f84ed18fa4adbcc95bc9209778a7859802393fea4f3c1176392d2b7 WatchSource:0}: Error finding container caf51fc21f84ed18fa4adbcc95bc9209778a7859802393fea4f3c1176392d2b7: Status 404 returned error can't find the container with id caf51fc21f84ed18fa4adbcc95bc9209778a7859802393fea4f3c1176392d2b7 Jul 15 22:43:48.450738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.450718 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:43:48.731744 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.731707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" event={"ID":"07a3455b-c9f0-4371-ac51-4cae2a176a9c","Type":"ContainerStarted","Data":"b8fcc8797eb0b2b0f75b980e718b6e6de28ee7529ab9778aa9cf0692f41e1da8"} Jul 15 22:43:48.731923 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.731754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" event={"ID":"07a3455b-c9f0-4371-ac51-4cae2a176a9c","Type":"ContainerStarted","Data":"caf51fc21f84ed18fa4adbcc95bc9209778a7859802393fea4f3c1176392d2b7"} Jul 15 22:43:48.750317 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:48.750266 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" podStartSLOduration=1.575687877 podStartE2EDuration="1.750245973s" totalImagesPullingTime="174.558096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:48.749063507 +0000 UTC m=+621.839714775" watchObservedRunningTime="2026-07-15 22:43:48.750245973 +0000 UTC m=+621.840897263" Jul 15 22:43:58.282449 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:58.282411 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:58.282845 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:58.282480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:58.295608 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:58.295582 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:43:58.794711 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:43:58.794683 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8mwkq" Jul 15 22:45:27.726830 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:27.726794 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:45:27.727356 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:27.727048 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" podUID="aa2b7472-caed-4e88-94f4-c830983cd6be" containerName="authorino" containerID="cri-o://3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024" gracePeriod=30 Jul 15 22:45:27.982465 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:27.982397 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:45:28.015872 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.015839 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert\") pod \"aa2b7472-caed-4e88-94f4-c830983cd6be\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " Jul 15 22:45:28.016097 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.015932 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2blxs\" (UniqueName: \"kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs\") pod \"aa2b7472-caed-4e88-94f4-c830983cd6be\" (UID: \"aa2b7472-caed-4e88-94f4-c830983cd6be\") " Jul 15 22:45:28.018118 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.018085 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs" (OuterVolumeSpecName: "kube-api-access-2blxs") pod "aa2b7472-caed-4e88-94f4-c830983cd6be" (UID: "aa2b7472-caed-4e88-94f4-c830983cd6be"). InnerVolumeSpecName "kube-api-access-2blxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:45:28.027542 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.027504 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aa2b7472-caed-4e88-94f4-c830983cd6be" (UID: "aa2b7472-caed-4e88-94f4-c830983cd6be"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:45:28.117071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.117022 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa2b7472-caed-4e88-94f4-c830983cd6be-tls-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:45:28.117071 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.117062 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2blxs\" (UniqueName: \"kubernetes.io/projected/aa2b7472-caed-4e88-94f4-c830983cd6be-kube-api-access-2blxs\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:45:28.252992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.252879 2556 generic.go:356] "Generic (PLEG): container finished" podID="aa2b7472-caed-4e88-94f4-c830983cd6be" containerID="3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024" exitCode=0 Jul 15 22:45:28.252992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.252934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" event={"ID":"aa2b7472-caed-4e88-94f4-c830983cd6be","Type":"ContainerDied","Data":"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024"} Jul 15 22:45:28.252992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.252979 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" Jul 15 22:45:28.252992 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.252993 2556 scope.go:117] "RemoveContainer" containerID="3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024" Jul 15 22:45:28.253319 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.252982 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5f5d664c-6pcrs" event={"ID":"aa2b7472-caed-4e88-94f4-c830983cd6be","Type":"ContainerDied","Data":"f46ad4741ddd51303a69d76535692ad5ba81b10330cc8479dccbd467dc83b354"} Jul 15 22:45:28.262913 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.262880 2556 scope.go:117] "RemoveContainer" containerID="3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024" Jul 15 22:45:28.263180 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:45:28.263161 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024\": container with ID starting with 3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024 not found: ID does not exist" containerID="3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024" Jul 15 22:45:28.263239 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.263189 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024"} err="failed to get container status \"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024\": rpc error: code = NotFound desc = could not find container \"3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024\": container with ID starting with 3b9f17495de33bcaad2cbe27ab294110d157c8c38647dceb946443924fd80024 not found: ID does not exist" Jul 15 22:45:28.278446 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.278414 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:45:28.281754 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:28.281728 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f5f5d664c-6pcrs"] Jul 15 22:45:29.404791 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:45:29.404755 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2b7472-caed-4e88-94f4-c830983cd6be" path="/var/lib/kubelet/pods/aa2b7472-caed-4e88-94f4-c830983cd6be/volumes" Jul 15 22:46:13.697052 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:13.697009 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:46:13.697565 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:13.697251 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6986b46494-qz6n8" podUID="e1ed1930-dfa1-45cf-8002-5a0a56444392" containerName="manager" containerID="cri-o://bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47" gracePeriod=30 Jul 15 22:46:13.951732 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:13.951661 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:46:14.073853 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.073816 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjzqv\" (UniqueName: \"kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv\") pod \"e1ed1930-dfa1-45cf-8002-5a0a56444392\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " Jul 15 22:46:14.074054 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.073924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert\") pod \"e1ed1930-dfa1-45cf-8002-5a0a56444392\" (UID: \"e1ed1930-dfa1-45cf-8002-5a0a56444392\") " Jul 15 22:46:14.076186 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.076156 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv" (OuterVolumeSpecName: "kube-api-access-hjzqv") pod "e1ed1930-dfa1-45cf-8002-5a0a56444392" (UID: "e1ed1930-dfa1-45cf-8002-5a0a56444392"). InnerVolumeSpecName "kube-api-access-hjzqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:46:14.076311 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.076159 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1ed1930-dfa1-45cf-8002-5a0a56444392" (UID: "e1ed1930-dfa1-45cf-8002-5a0a56444392"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:46:14.174927 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.174871 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjzqv\" (UniqueName: \"kubernetes.io/projected/e1ed1930-dfa1-45cf-8002-5a0a56444392-kube-api-access-hjzqv\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:46:14.174927 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.174929 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1ed1930-dfa1-45cf-8002-5a0a56444392-webhook-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:46:14.495127 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.495096 2556 generic.go:356] "Generic (PLEG): container finished" podID="e1ed1930-dfa1-45cf-8002-5a0a56444392" containerID="bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47" exitCode=0 Jul 15 22:46:14.495324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.495151 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-qz6n8" Jul 15 22:46:14.495324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.495181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-qz6n8" event={"ID":"e1ed1930-dfa1-45cf-8002-5a0a56444392","Type":"ContainerDied","Data":"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47"} Jul 15 22:46:14.495324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.495237 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-qz6n8" event={"ID":"e1ed1930-dfa1-45cf-8002-5a0a56444392","Type":"ContainerDied","Data":"36f2d8335b02cc848178c7a0ab0d70b573dfc67c1b6c868b5b879a250383ff50"} Jul 15 22:46:14.495324 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.495258 2556 scope.go:117] "RemoveContainer" containerID="bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47" Jul 15 22:46:14.504628 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.504612 2556 scope.go:117] "RemoveContainer" containerID="bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47" Jul 15 22:46:14.504880 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:46:14.504863 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47\": container with ID starting with bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47 not found: ID does not exist" containerID="bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47" Jul 15 22:46:14.504956 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.504891 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47"} err="failed to get container status \"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47\": rpc error: code = NotFound desc = could not find container \"bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47\": container with ID starting with bcb335274b4b5475972a972a24b885c0b94e6420ef6bed057ca35867beedfa47 not found: ID does not exist" Jul 15 22:46:14.516286 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.516261 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:46:14.522015 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:14.521986 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6986b46494-qz6n8"] Jul 15 22:46:15.404853 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:46:15.404814 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ed1930-dfa1-45cf-8002-5a0a56444392" path="/var/lib/kubelet/pods/e1ed1930-dfa1-45cf-8002-5a0a56444392/volumes" Jul 15 22:47:15.297468 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.297427 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:15.298104 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298085 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2b7472-caed-4e88-94f4-c830983cd6be" containerName="authorino" Jul 15 22:47:15.298180 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298108 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2b7472-caed-4e88-94f4-c830983cd6be" containerName="authorino" Jul 15 22:47:15.298180 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298121 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ed1930-dfa1-45cf-8002-5a0a56444392" containerName="manager" Jul 15 22:47:15.298180 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298131 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ed1930-dfa1-45cf-8002-5a0a56444392" containerName="manager" Jul 15 22:47:15.298293 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298214 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2b7472-caed-4e88-94f4-c830983cd6be" containerName="authorino" Jul 15 22:47:15.298293 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.298227 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1ed1930-dfa1-45cf-8002-5a0a56444392" containerName="manager" Jul 15 22:47:15.301536 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.301518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.304282 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.304258 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 22:47:15.304423 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.304264 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p6pv7\"" Jul 15 22:47:15.304423 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.304264 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 22:47:15.310838 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.310810 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:15.389533 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.389495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.389731 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.389555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cqm\" (UniqueName: \"kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.490813 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.490774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.491027 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.490840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cqm\" (UniqueName: \"kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.493430 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.493402 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.499581 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.499553 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cqm\" (UniqueName: \"kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm\") pod \"maas-controller-6986b46494-7jztl\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.612863 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.612772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:15.754060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.754029 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:15.756208 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:47:15.756185 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2d44a5_52ac_4d4e_bc0f_2a58dc38515a.slice/crio-d3d6401ff78c4b123374472ce398cc18a8cc34087c03bc6052c76f100c034fd9 WatchSource:0}: Error finding container d3d6401ff78c4b123374472ce398cc18a8cc34087c03bc6052c76f100c034fd9: Status 404 returned error can't find the container with id d3d6401ff78c4b123374472ce398cc18a8cc34087c03bc6052c76f100c034fd9 Jul 15 22:47:15.809786 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:15.809747 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-7jztl" event={"ID":"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a","Type":"ContainerStarted","Data":"d3d6401ff78c4b123374472ce398cc18a8cc34087c03bc6052c76f100c034fd9"} Jul 15 22:47:16.816479 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:16.816438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-7jztl" event={"ID":"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a","Type":"ContainerStarted","Data":"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4"} Jul 15 22:47:16.816938 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:16.816504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:16.835061 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:16.835009 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6986b46494-7jztl" podStartSLOduration=1.271457516 podStartE2EDuration="1.834990167s" totalImagesPullingTime="563.532651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:47:16.832208542 +0000 UTC m=+829.922859786" watchObservedRunningTime="2026-07-15 22:47:16.834990167 +0000 UTC m=+829.925641411" Jul 15 22:47:27.824415 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:27.824377 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:32.454006 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.453951 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:32.454468 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.454191 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6986b46494-7jztl" podUID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" containerName="manager" containerID="cri-o://cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4" gracePeriod=30 Jul 15 22:47:32.718310 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.718282 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:32.866738 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.866693 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert\") pod \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " Jul 15 22:47:32.866944 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.866764 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6cqm\" (UniqueName: \"kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm\") pod \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\" (UID: \"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a\") " Jul 15 22:47:32.869076 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.869039 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" (UID: "4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:47:32.869076 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.869055 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm" (OuterVolumeSpecName: "kube-api-access-k6cqm") pod "4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" (UID: "4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a"). InnerVolumeSpecName "kube-api-access-k6cqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:47:32.896890 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.896857 2556 generic.go:356] "Generic (PLEG): container finished" podID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" containerID="cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4" exitCode=0 Jul 15 22:47:32.897060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.896918 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-7jztl" Jul 15 22:47:32.897060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.896931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-7jztl" event={"ID":"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a","Type":"ContainerDied","Data":"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4"} Jul 15 22:47:32.897060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.896989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-7jztl" event={"ID":"4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a","Type":"ContainerDied","Data":"d3d6401ff78c4b123374472ce398cc18a8cc34087c03bc6052c76f100c034fd9"} Jul 15 22:47:32.897060 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.897012 2556 scope.go:117] "RemoveContainer" containerID="cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4" Jul 15 22:47:32.906405 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.906387 2556 scope.go:117] "RemoveContainer" containerID="cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4" Jul 15 22:47:32.906720 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:47:32.906698 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4\": container with ID starting with cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4 not found: ID does not exist" containerID="cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4" Jul 15 22:47:32.906773 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.906731 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4"} err="failed to get container status \"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4\": rpc error: code = NotFound desc = could not find container \"cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4\": container with ID starting with cad03350eb4cfc858079b5e4e69144d82f96f93f40bdbbb613c26ef31312e7f4 not found: ID does not exist" Jul 15 22:47:32.918362 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.918325 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:32.922329 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.922299 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6986b46494-7jztl"] Jul 15 22:47:32.968214 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.968173 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-webhook-cert\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:47:32.968214 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:32.968208 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6cqm\" (UniqueName: \"kubernetes.io/projected/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a-kube-api-access-k6cqm\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 22:47:33.405131 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.405087 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" path="/var/lib/kubelet/pods/4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a/volumes" Jul 15 22:47:33.676064 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.675987 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6986b46494-psbd6"] Jul 15 22:47:33.676443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.676413 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" containerName="manager" Jul 15 22:47:33.676443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.676426 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" containerName="manager" Jul 15 22:47:33.676574 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.676504 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b2d44a5-52ac-4d4e-bc0f-2a58dc38515a" containerName="manager" Jul 15 22:47:33.680947 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.680929 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.684443 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.684418 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 22:47:33.684622 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.684418 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 22:47:33.684622 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.684495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p6pv7\"" Jul 15 22:47:33.689618 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.689591 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-psbd6"] Jul 15 22:47:33.775064 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.775022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjtm\" (UniqueName: \"kubernetes.io/projected/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-kube-api-access-5fjtm\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.775246 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.775122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-webhook-cert\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.876063 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.876029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-webhook-cert\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.876250 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.876098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjtm\" (UniqueName: \"kubernetes.io/projected/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-kube-api-access-5fjtm\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.878946 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.878894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-webhook-cert\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.884269 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.884243 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjtm\" (UniqueName: \"kubernetes.io/projected/33a3db41-54bf-4ec2-9954-54c9ebfdae5f-kube-api-access-5fjtm\") pod \"maas-controller-6986b46494-psbd6\" (UID: \"33a3db41-54bf-4ec2-9954-54c9ebfdae5f\") " pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:33.992888 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:33.992850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:34.134763 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:34.134606 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6986b46494-psbd6"] Jul 15 22:47:34.137197 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:47:34.137171 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a3db41_54bf_4ec2_9954_54c9ebfdae5f.slice/crio-80b88490e493302f6b8ad00e4c46c58773854096d64bc7654a79997a1cfb2b1c WatchSource:0}: Error finding container 80b88490e493302f6b8ad00e4c46c58773854096d64bc7654a79997a1cfb2b1c: Status 404 returned error can't find the container with id 80b88490e493302f6b8ad00e4c46c58773854096d64bc7654a79997a1cfb2b1c Jul 15 22:47:34.909969 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:34.909936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-psbd6" event={"ID":"33a3db41-54bf-4ec2-9954-54c9ebfdae5f","Type":"ContainerStarted","Data":"80b88490e493302f6b8ad00e4c46c58773854096d64bc7654a79997a1cfb2b1c"} Jul 15 22:47:35.916545 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:35.916500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6986b46494-psbd6" event={"ID":"33a3db41-54bf-4ec2-9954-54c9ebfdae5f","Type":"ContainerStarted","Data":"d56c32536db657716ca8f0bd952aa618886e03038e08533f4c3d20f2e3c4e0a5"} Jul 15 22:47:35.916962 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:35.916691 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:47:35.934386 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:35.934336 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6986b46494-psbd6" podStartSLOduration=2.1482718849999998 podStartE2EDuration="2.934319493s" totalImagesPullingTime="786.047608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:47:35.93245493 +0000 UTC m=+849.023106185" watchObservedRunningTime="2026-07-15 22:47:35.934319493 +0000 UTC m=+849.024970735" Jul 15 22:47:46.923724 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:47:46.923691 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6986b46494-psbd6" Jul 15 22:48:27.365139 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:48:27.365055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:48:27.368674 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:48:27.368649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:53:27.397883 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:53:27.397799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:53:27.403656 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:53:27.403629 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:58:27.435270 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:58:27.435240 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:58:27.443741 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:58:27.443713 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 22:59:33.705218 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.705179 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k"] Jul 15 22:59:33.709648 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.709621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.712564 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.712542 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5d538e1f-serving-cert\"" Jul 15 22:59:33.721412 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.721381 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k"] Jul 15 22:59:33.788971 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.788864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc35b9b7-1789-4a52-93ec-5a95367f7a78-openshift-service-ca\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.788971 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.788936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.789153 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.789010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rd9\" (UniqueName: \"kubernetes.io/projected/fc35b9b7-1789-4a52-93ec-5a95367f7a78-kube-api-access-29rd9\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.890266 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.890227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rd9\" (UniqueName: \"kubernetes.io/projected/fc35b9b7-1789-4a52-93ec-5a95367f7a78-kube-api-access-29rd9\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.890462 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.890296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc35b9b7-1789-4a52-93ec-5a95367f7a78-openshift-service-ca\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.890462 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.890318 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.890462 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:59:33.890433 2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-serving-cert: secret "maas-api-e2e-ait-5d538e1f-serving-cert" not found Jul 15 22:59:33.890591 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:59:33.890481 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls podName:fc35b9b7-1789-4a52-93ec-5a95367f7a78 nodeName:}" failed. No retries permitted until 2026-07-15 22:59:34.390465683 +0000 UTC m=+1567.481116905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls") pod "maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" (UID: "fc35b9b7-1789-4a52-93ec-5a95367f7a78") : secret "maas-api-e2e-ait-5d538e1f-serving-cert" not found Jul 15 22:59:33.891016 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.890997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc35b9b7-1789-4a52-93ec-5a95367f7a78-openshift-service-ca\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:33.899103 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:33.899073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rd9\" (UniqueName: \"kubernetes.io/projected/fc35b9b7-1789-4a52-93ec-5a95367f7a78-kube-api-access-29rd9\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:34.395084 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:34.395039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:34.397886 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:34.397858 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc35b9b7-1789-4a52-93ec-5a95367f7a78-maas-api-tls\") pod \"maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k\" (UID: \"fc35b9b7-1789-4a52-93ec-5a95367f7a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:34.623658 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:34.623621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:34.765630 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:34.765600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k"] Jul 15 22:59:34.768647 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:59:34.768615 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc35b9b7_1789_4a52_93ec_5a95367f7a78.slice/crio-185afcde7df10833fcdf0e0f1d0288daf18a8dc56026cc834ff7946f58153561 WatchSource:0}: Error finding container 185afcde7df10833fcdf0e0f1d0288daf18a8dc56026cc834ff7946f58153561: Status 404 returned error can't find the container with id 185afcde7df10833fcdf0e0f1d0288daf18a8dc56026cc834ff7946f58153561 Jul 15 22:59:34.770302 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:34.770270 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:59:35.577685 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:35.577577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" event={"ID":"fc35b9b7-1789-4a52-93ec-5a95367f7a78","Type":"ContainerStarted","Data":"e47daf7ae9973b959623f847bf496d147ae6df147239f78e74e824d813e24b2d"} Jul 15 22:59:35.577685 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:35.577635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" event={"ID":"fc35b9b7-1789-4a52-93ec-5a95367f7a78","Type":"ContainerStarted","Data":"185afcde7df10833fcdf0e0f1d0288daf18a8dc56026cc834ff7946f58153561"} Jul 15 22:59:35.577685 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:35.577663 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:35.593254 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:35.593180 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" podStartSLOduration=2.12794964 podStartE2EDuration="2.593133615s" totalImagesPullingTime="465.183975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:35.592389094 +0000 UTC m=+1568.683040337" watchObservedRunningTime="2026-07-15 22:59:35.593133615 +0000 UTC m=+1568.683784857" Jul 15 22:59:41.588694 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:41.588666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k" Jul 15 22:59:46.172053 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.171952 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7"] Jul 15 22:59:46.176390 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.176366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.178815 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.178789 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-56f79d48-serving-cert\"" Jul 15 22:59:46.187554 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.187526 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7"] Jul 15 22:59:46.318606 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.318564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01593f34-2fea-4515-bdc4-c452b2f5b2ae-maas-api-tls\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.318606 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.318607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67t5n\" (UniqueName: \"kubernetes.io/projected/01593f34-2fea-4515-bdc4-c452b2f5b2ae-kube-api-access-67t5n\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.318842 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.318710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01593f34-2fea-4515-bdc4-c452b2f5b2ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.419390 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.419353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01593f34-2fea-4515-bdc4-c452b2f5b2ae-maas-api-tls\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.419390 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.419395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67t5n\" (UniqueName: \"kubernetes.io/projected/01593f34-2fea-4515-bdc4-c452b2f5b2ae-kube-api-access-67t5n\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.419621 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.419457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01593f34-2fea-4515-bdc4-c452b2f5b2ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.420267 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.420190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01593f34-2fea-4515-bdc4-c452b2f5b2ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.422033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.422007 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01593f34-2fea-4515-bdc4-c452b2f5b2ae-maas-api-tls\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.428030 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.427967 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67t5n\" (UniqueName: \"kubernetes.io/projected/01593f34-2fea-4515-bdc4-c452b2f5b2ae-kube-api-access-67t5n\") pod \"maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7\" (UID: \"01593f34-2fea-4515-bdc4-c452b2f5b2ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.489634 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.489597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:46.637775 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:46.637744 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7"] Jul 15 22:59:46.639758 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:59:46.639722 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01593f34_2fea_4515_bdc4_c452b2f5b2ae.slice/crio-2be960b306fd7513a74f0e990a7f040e36e953651319ec8f27b722beeccb6af2 WatchSource:0}: Error finding container 2be960b306fd7513a74f0e990a7f040e36e953651319ec8f27b722beeccb6af2: Status 404 returned error can't find the container with id 2be960b306fd7513a74f0e990a7f040e36e953651319ec8f27b722beeccb6af2 Jul 15 22:59:47.645912 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:47.645876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" event={"ID":"01593f34-2fea-4515-bdc4-c452b2f5b2ae","Type":"ContainerStarted","Data":"d794e23dfee49ddfa5358d7f020269514d94e489cf6ff661dca312ab40bde538"} Jul 15 22:59:47.646301 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:47.645945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" event={"ID":"01593f34-2fea-4515-bdc4-c452b2f5b2ae","Type":"ContainerStarted","Data":"2be960b306fd7513a74f0e990a7f040e36e953651319ec8f27b722beeccb6af2"} Jul 15 22:59:47.646301 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:47.646030 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:47.662664 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:47.662611 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" podStartSLOduration=1.279670606 podStartE2EDuration="1.662594492s" totalImagesPullingTime="382.923886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:47.661152275 +0000 UTC m=+1580.751803518" watchObservedRunningTime="2026-07-15 22:59:47.662594492 +0000 UTC m=+1580.753245734" Jul 15 22:59:53.656683 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:53.656652 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7" Jul 15 22:59:57.986710 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:57.986678 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw"] Jul 15 22:59:57.990505 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:57.990484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:57.993316 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:57.993286 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ccc4377e-serving-cert\"" Jul 15 22:59:57.996608 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:57.996579 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw"] Jul 15 22:59:58.032466 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.032431 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4m76\" (UniqueName: \"kubernetes.io/projected/bd9da65a-d0b0-42f3-8695-3a885f308f13-kube-api-access-m4m76\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.032641 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.032480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.032641 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.032597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd9da65a-d0b0-42f3-8695-3a885f308f13-openshift-service-ca\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.133866 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.133765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd9da65a-d0b0-42f3-8695-3a885f308f13-openshift-service-ca\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.133866 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.133829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4m76\" (UniqueName: \"kubernetes.io/projected/bd9da65a-d0b0-42f3-8695-3a885f308f13-kube-api-access-m4m76\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.133866 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.133856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.134137 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:59:58.134106 2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-serving-cert: secret "maas-api-e2e-derive-ccc4377e-serving-cert" not found Jul 15 22:59:58.134200 ip-10-0-139-147 kubenswrapper[2556]: E0715 22:59:58.134173 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls podName:bd9da65a-d0b0-42f3-8695-3a885f308f13 nodeName:}" failed. No retries permitted until 2026-07-15 22:59:58.634154312 +0000 UTC m=+1591.724805536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls") pod "maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" (UID: "bd9da65a-d0b0-42f3-8695-3a885f308f13") : secret "maas-api-e2e-derive-ccc4377e-serving-cert" not found Jul 15 22:59:58.134418 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.134397 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd9da65a-d0b0-42f3-8695-3a885f308f13-openshift-service-ca\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.143593 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.143570 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4m76\" (UniqueName: \"kubernetes.io/projected/bd9da65a-d0b0-42f3-8695-3a885f308f13-kube-api-access-m4m76\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.638787 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.638753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.641391 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.641363 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd9da65a-d0b0-42f3-8695-3a885f308f13-maas-api-tls\") pod \"maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw\" (UID: \"bd9da65a-d0b0-42f3-8695-3a885f308f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:58.904848 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:58.904741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:59.047033 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:59.046999 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw"] Jul 15 22:59:59.049766 ip-10-0-139-147 kubenswrapper[2556]: W0715 22:59:59.049735 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9da65a_d0b0_42f3_8695_3a885f308f13.slice/crio-3690dc8a88bf6a95b8e91c4c7bc30b6a056f893fa81f2e680daf1405cdd22ffd WatchSource:0}: Error finding container 3690dc8a88bf6a95b8e91c4c7bc30b6a056f893fa81f2e680daf1405cdd22ffd: Status 404 returned error can't find the container with id 3690dc8a88bf6a95b8e91c4c7bc30b6a056f893fa81f2e680daf1405cdd22ffd Jul 15 22:59:59.718871 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:59.718837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" event={"ID":"bd9da65a-d0b0-42f3-8695-3a885f308f13","Type":"ContainerStarted","Data":"b542e8fbbedecae864541b5cf7b5a86dc5d55170dccfbb37531b1ba40a4b4a25"} Jul 15 22:59:59.719092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:59.718890 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" event={"ID":"bd9da65a-d0b0-42f3-8695-3a885f308f13","Type":"ContainerStarted","Data":"3690dc8a88bf6a95b8e91c4c7bc30b6a056f893fa81f2e680daf1405cdd22ffd"} Jul 15 22:59:59.719092 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:59.718992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 22:59:59.734644 ip-10-0-139-147 kubenswrapper[2556]: I0715 22:59:59.734587 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" podStartSLOduration=2.433220085 podStartE2EDuration="2.734568871s" totalImagesPullingTime="301.348786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:59.733799185 +0000 UTC m=+1592.824450429" watchObservedRunningTime="2026-07-15 22:59:59.734568871 +0000 UTC m=+1592.825220114" Jul 15 23:00:05.730198 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:00:05.730166 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw" Jul 15 23:03:27.469625 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:03:27.469584 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:03:27.480010 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:03:27.479985 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:05:27.526932 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.526823 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw"] Jul 15 23:05:27.531525 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.531495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.534060 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.534033 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e81434-serving-cert\"" Jul 15 23:05:27.540056 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.540025 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw"] Jul 15 23:05:27.684490 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.684450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b73a099-5f98-4c55-acae-fa5c1585df6e-openshift-service-ca\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.684651 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.684536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5hb\" (UniqueName: \"kubernetes.io/projected/4b73a099-5f98-4c55-acae-fa5c1585df6e-kube-api-access-vc5hb\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.684651 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.684572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b73a099-5f98-4c55-acae-fa5c1585df6e-maas-api-tls\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.786153 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.786056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b73a099-5f98-4c55-acae-fa5c1585df6e-maas-api-tls\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.786310 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.786170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b73a099-5f98-4c55-acae-fa5c1585df6e-openshift-service-ca\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.786310 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.786249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5hb\" (UniqueName: \"kubernetes.io/projected/4b73a099-5f98-4c55-acae-fa5c1585df6e-kube-api-access-vc5hb\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.787020 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.786960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b73a099-5f98-4c55-acae-fa5c1585df6e-openshift-service-ca\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.788699 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.788678 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b73a099-5f98-4c55-acae-fa5c1585df6e-maas-api-tls\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.794795 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.794776 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5hb\" (UniqueName: \"kubernetes.io/projected/4b73a099-5f98-4c55-acae-fa5c1585df6e-kube-api-access-vc5hb\") pod \"maas-api-e2e-api-b-e81434-566f584d7f-qwwvw\" (UID: \"4b73a099-5f98-4c55-acae-fa5c1585df6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.846881 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.846842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:27.996595 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:27.996551 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw"] Jul 15 23:05:27.999879 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:05:27.999850 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b73a099_5f98_4c55_acae_fa5c1585df6e.slice/crio-7e259065ae273088787d059081f982546369d711513e0458f5045a6befb1acab WatchSource:0}: Error finding container 7e259065ae273088787d059081f982546369d711513e0458f5045a6befb1acab: Status 404 returned error can't find the container with id 7e259065ae273088787d059081f982546369d711513e0458f5045a6befb1acab Jul 15 23:05:28.001170 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:28.001151 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:05:28.473306 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:28.473265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" event={"ID":"4b73a099-5f98-4c55-acae-fa5c1585df6e","Type":"ContainerStarted","Data":"a4eb61af27f084dae06c833f1d4231c5c52ff14a99f443431ba7ce8b34d9eedb"} Jul 15 23:05:28.473508 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:28.473324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" event={"ID":"4b73a099-5f98-4c55-acae-fa5c1585df6e","Type":"ContainerStarted","Data":"7e259065ae273088787d059081f982546369d711513e0458f5045a6befb1acab"} Jul 15 23:05:28.473508 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:28.473469 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:05:28.490137 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:28.490084 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" podStartSLOduration=1.165820205 podStartE2EDuration="1.490070089s" totalImagesPullingTime="324.249884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:05:28.489129379 +0000 UTC m=+1921.579780623" watchObservedRunningTime="2026-07-15 23:05:28.490070089 +0000 UTC m=+1921.580721332" Jul 15 23:05:34.484452 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:05:34.484426 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e81434-566f584d7f-qwwvw" Jul 15 23:06:15.853725 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.853685 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks"] Jul 15 23:06:15.857524 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.857500 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.860250 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.860220 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c6dbd3-serving-cert\"" Jul 15 23:06:15.869135 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.869101 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks"] Jul 15 23:06:15.878265 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.878231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cgc\" (UniqueName: \"kubernetes.io/projected/597c3fcf-3339-48e3-97e5-ae17040a8b9d-kube-api-access-g6cgc\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.878479 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.878282 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597c3fcf-3339-48e3-97e5-ae17040a8b9d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.878561 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.878476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.979935 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.979877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cgc\" (UniqueName: \"kubernetes.io/projected/597c3fcf-3339-48e3-97e5-ae17040a8b9d-kube-api-access-g6cgc\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.980110 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.979959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597c3fcf-3339-48e3-97e5-ae17040a8b9d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.980110 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.980013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.980195 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:06:15.980130 2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-serving-cert: secret "maas-api-e2e-shared-b-c6dbd3-serving-cert" not found Jul 15 23:06:15.980233 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:06:15.980221 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls podName:597c3fcf-3339-48e3-97e5-ae17040a8b9d nodeName:}" failed. No retries permitted until 2026-07-15 23:06:16.480200741 +0000 UTC m=+1969.570851961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls") pod "maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" (UID: "597c3fcf-3339-48e3-97e5-ae17040a8b9d") : secret "maas-api-e2e-shared-b-c6dbd3-serving-cert" not found Jul 15 23:06:15.980699 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.980681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597c3fcf-3339-48e3-97e5-ae17040a8b9d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:15.992243 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:15.992213 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cgc\" (UniqueName: \"kubernetes.io/projected/597c3fcf-3339-48e3-97e5-ae17040a8b9d-kube-api-access-g6cgc\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:16.485975 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:16.485928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:16.488671 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:16.488638 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597c3fcf-3339-48e3-97e5-ae17040a8b9d-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks\" (UID: \"597c3fcf-3339-48e3-97e5-ae17040a8b9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:16.771641 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:16.771543 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:16.920548 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:16.920510 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks"] Jul 15 23:06:16.922874 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:06:16.922843 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597c3fcf_3339_48e3_97e5_ae17040a8b9d.slice/crio-d81b2c2067a28ba6255ab5b6a4e6b1980ed7041eb2e9cfa17ba3f4ba14547a8e WatchSource:0}: Error finding container d81b2c2067a28ba6255ab5b6a4e6b1980ed7041eb2e9cfa17ba3f4ba14547a8e: Status 404 returned error can't find the container with id d81b2c2067a28ba6255ab5b6a4e6b1980ed7041eb2e9cfa17ba3f4ba14547a8e Jul 15 23:06:17.730995 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:17.730958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" event={"ID":"597c3fcf-3339-48e3-97e5-ae17040a8b9d","Type":"ContainerStarted","Data":"2938d82a378acba6c617552936220bc2004fbdadbc83c6006aa4cec8451b325f"} Jul 15 23:06:17.731195 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:17.731018 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" event={"ID":"597c3fcf-3339-48e3-97e5-ae17040a8b9d","Type":"ContainerStarted","Data":"d81b2c2067a28ba6255ab5b6a4e6b1980ed7041eb2e9cfa17ba3f4ba14547a8e"} Jul 15 23:06:17.731195 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:17.731129 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:06:17.769147 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:17.769084 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" podStartSLOduration=2.39134217 podStartE2EDuration="2.769067943s" totalImagesPullingTime="377.725773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:06:17.767862859 +0000 UTC m=+1970.858514113" watchObservedRunningTime="2026-07-15 23:06:17.769067943 +0000 UTC m=+1970.859719185" Jul 15 23:06:23.741687 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:06:23.741655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks" Jul 15 23:08:27.504429 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:08:27.504340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:08:27.516691 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:08:27.516663 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:12:44.285025 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.284990 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665074836144"] Jul 15 23:12:44.288877 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.288857 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:44.292326 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.292299 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tnhp6\"" Jul 15 23:12:44.293815 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.293790 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074836144"] Jul 15 23:12:44.387459 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.387420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gdv9\" (UniqueName: \"kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9\") pod \"test-curl-7334-139665074836144\" (UID: \"5db42bdc-0691-441d-97dd-b2bd52ba0450\") " pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:44.488009 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.487973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gdv9\" (UniqueName: \"kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9\") pod \"test-curl-7334-139665074836144\" (UID: \"5db42bdc-0691-441d-97dd-b2bd52ba0450\") " pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:44.496852 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.496824 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gdv9\" (UniqueName: \"kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9\") pod \"test-curl-7334-139665074836144\" (UID: \"5db42bdc-0691-441d-97dd-b2bd52ba0450\") " pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:44.599378 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.599294 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:44.742191 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.742164 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074836144"] Jul 15 23:12:44.744712 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:44.744675 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5db42bdc_0691_441d_97dd_b2bd52ba0450.slice/crio-bffe959170e7573fe3e6e130114d233147a3a95cdbbcf6334db601d02ef77603 WatchSource:0}: Error finding container bffe959170e7573fe3e6e130114d233147a3a95cdbbcf6334db601d02ef77603: Status 404 returned error can't find the container with id bffe959170e7573fe3e6e130114d233147a3a95cdbbcf6334db601d02ef77603 Jul 15 23:12:44.746191 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.746167 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:12:44.805423 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:44.805388 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074836144" event={"ID":"5db42bdc-0691-441d-97dd-b2bd52ba0450","Type":"ContainerStarted","Data":"bffe959170e7573fe3e6e130114d233147a3a95cdbbcf6334db601d02ef77603"} Jul 15 23:12:45.812606 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:45.812565 2556 generic.go:356] "Generic (PLEG): container finished" podID="5db42bdc-0691-441d-97dd-b2bd52ba0450" containerID="715ec27ca3a423dad4ea478f59decec560b10d31833642e814a952ed98d06e99" exitCode=0 Jul 15 23:12:45.813101 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:45.812652 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074836144" event={"ID":"5db42bdc-0691-441d-97dd-b2bd52ba0450","Type":"ContainerDied","Data":"715ec27ca3a423dad4ea478f59decec560b10d31833642e814a952ed98d06e99"} Jul 15 23:12:46.965249 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:46.965223 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:47.000431 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.000388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665074836144_5db42bdc-0691-441d-97dd-b2bd52ba0450/test-curl-7334-139665074836144/0.log" Jul 15 23:12:47.022659 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.022618 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665074836144"] Jul 15 23:12:47.026501 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.026470 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665074836144"] Jul 15 23:12:47.118284 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.118252 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gdv9\" (UniqueName: \"kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9\") pod \"5db42bdc-0691-441d-97dd-b2bd52ba0450\" (UID: \"5db42bdc-0691-441d-97dd-b2bd52ba0450\") " Jul 15 23:12:47.120538 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.120515 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9" (OuterVolumeSpecName: "kube-api-access-2gdv9") pod "5db42bdc-0691-441d-97dd-b2bd52ba0450" (UID: "5db42bdc-0691-441d-97dd-b2bd52ba0450"). InnerVolumeSpecName "kube-api-access-2gdv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:12:47.149884 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.149848 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665074838576"] Jul 15 23:12:47.150333 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.150318 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db42bdc-0691-441d-97dd-b2bd52ba0450" containerName="test-curl-7334-139665074836144" Jul 15 23:12:47.150376 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.150335 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db42bdc-0691-441d-97dd-b2bd52ba0450" containerName="test-curl-7334-139665074836144" Jul 15 23:12:47.150431 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.150421 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db42bdc-0691-441d-97dd-b2bd52ba0450" containerName="test-curl-7334-139665074836144" Jul 15 23:12:47.153948 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.153930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:47.157828 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.157805 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074838576"] Jul 15 23:12:47.220025 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.219993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd\") pod \"test-curl-7334-139665074838576\" (UID: \"d456e857-feb2-4b1c-9476-ee7c7d22ebd2\") " pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:47.220197 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.220102 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gdv9\" (UniqueName: \"kubernetes.io/projected/5db42bdc-0691-441d-97dd-b2bd52ba0450-kube-api-access-2gdv9\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:12:47.320814 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.320769 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd\") pod \"test-curl-7334-139665074838576\" (UID: \"d456e857-feb2-4b1c-9476-ee7c7d22ebd2\") " pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:47.329719 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.329684 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd\") pod \"test-curl-7334-139665074838576\" (UID: \"d456e857-feb2-4b1c-9476-ee7c7d22ebd2\") " pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:47.405700 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.405662 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db42bdc-0691-441d-97dd-b2bd52ba0450" path="/var/lib/kubelet/pods/5db42bdc-0691-441d-97dd-b2bd52ba0450/volumes" Jul 15 23:12:47.464862 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.464823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:47.616823 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.616785 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074838576"] Jul 15 23:12:47.620761 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:47.620733 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd456e857_feb2_4b1c_9476_ee7c7d22ebd2.slice/crio-fe75388498f34e542e6b400417c0a29f4857a8114fd031d7c6cacfc699d3144f WatchSource:0}: Error finding container fe75388498f34e542e6b400417c0a29f4857a8114fd031d7c6cacfc699d3144f: Status 404 returned error can't find the container with id fe75388498f34e542e6b400417c0a29f4857a8114fd031d7c6cacfc699d3144f Jul 15 23:12:47.824516 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.824417 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074838576" event={"ID":"d456e857-feb2-4b1c-9476-ee7c7d22ebd2","Type":"ContainerStarted","Data":"fe75388498f34e542e6b400417c0a29f4857a8114fd031d7c6cacfc699d3144f"} Jul 15 23:12:47.825594 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.825565 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074836144" Jul 15 23:12:47.825594 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:47.825588 2556 scope.go:117] "RemoveContainer" containerID="715ec27ca3a423dad4ea478f59decec560b10d31833642e814a952ed98d06e99" Jul 15 23:12:48.832205 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:48.832174 2556 generic.go:356] "Generic (PLEG): container finished" podID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" containerID="ee2eb851a1b7f6e8d83bf26c4372782ae4d1e8a3ccf3ea7439e35b277e2946bd" exitCode=0 Jul 15 23:12:48.832613 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:48.832254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074838576" event={"ID":"d456e857-feb2-4b1c-9476-ee7c7d22ebd2","Type":"ContainerDied","Data":"ee2eb851a1b7f6e8d83bf26c4372782ae4d1e8a3ccf3ea7439e35b277e2946bd"} Jul 15 23:12:49.982434 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:49.982399 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:50.001967 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.001932 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665074838576_d456e857-feb2-4b1c-9476-ee7c7d22ebd2/test-curl-7334-139665074838576/0.log" Jul 15 23:12:50.023875 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.023825 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665074838576"] Jul 15 23:12:50.027590 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.027561 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665074838576"] Jul 15 23:12:50.148129 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.148035 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd\") pod \"d456e857-feb2-4b1c-9476-ee7c7d22ebd2\" (UID: \"d456e857-feb2-4b1c-9476-ee7c7d22ebd2\") " Jul 15 23:12:50.150244 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.150219 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd" (OuterVolumeSpecName: "kube-api-access-j7ttd") pod "d456e857-feb2-4b1c-9476-ee7c7d22ebd2" (UID: "d456e857-feb2-4b1c-9476-ee7c7d22ebd2"). InnerVolumeSpecName "kube-api-access-j7ttd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:12:50.183504 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.183469 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:50.183958 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.183942 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" containerName="test-curl-7334-139665074838576" Jul 15 23:12:50.184002 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.183960 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" containerName="test-curl-7334-139665074838576" Jul 15 23:12:50.184034 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.184020 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" containerName="test-curl-7334-139665074838576" Jul 15 23:12:50.193611 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.193581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:50.194434 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.194411 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:50.249508 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.249476 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7ttd\" (UniqueName: \"kubernetes.io/projected/d456e857-feb2-4b1c-9476-ee7c7d22ebd2-kube-api-access-j7ttd\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:12:50.350075 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.350035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48m6r\" (UniqueName: \"kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r\") pod \"test-curl-7334-139665078652336\" (UID: \"fcb9fd4a-b1c0-45a4-9d75-659c49962818\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:50.451445 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.451344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48m6r\" (UniqueName: \"kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r\") pod \"test-curl-7334-139665078652336\" (UID: \"fcb9fd4a-b1c0-45a4-9d75-659c49962818\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:50.459697 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.459663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48m6r\" (UniqueName: \"kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r\") pod \"test-curl-7334-139665078652336\" (UID: \"fcb9fd4a-b1c0-45a4-9d75-659c49962818\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:50.504274 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.504233 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:50.645069 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.645040 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:50.647116 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:50.647085 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcb9fd4a_b1c0_45a4_9d75_659c49962818.slice/crio-09d4397dc5fc7201a1fb5febf38e6ebc283ba0e705c28f4e88d79ac629397e5f WatchSource:0}: Error finding container 09d4397dc5fc7201a1fb5febf38e6ebc283ba0e705c28f4e88d79ac629397e5f: Status 404 returned error can't find the container with id 09d4397dc5fc7201a1fb5febf38e6ebc283ba0e705c28f4e88d79ac629397e5f Jul 15 23:12:50.844427 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.844392 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:50.844427 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.844411 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe75388498f34e542e6b400417c0a29f4857a8114fd031d7c6cacfc699d3144f" Jul 15 23:12:50.845693 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:50.845666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665078652336" event={"ID":"fcb9fd4a-b1c0-45a4-9d75-659c49962818","Type":"ContainerStarted","Data":"09d4397dc5fc7201a1fb5febf38e6ebc283ba0e705c28f4e88d79ac629397e5f"} Jul 15 23:12:50.854779 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:12:50.854752 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7334-139665074838576\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" pod="opendatahub/test-curl-7334-139665074838576" Jul 15 23:12:51.404784 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:51.404738 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d456e857-feb2-4b1c-9476-ee7c7d22ebd2" path="/var/lib/kubelet/pods/d456e857-feb2-4b1c-9476-ee7c7d22ebd2/volumes" Jul 15 23:12:51.852825 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:51.852787 2556 generic.go:356] "Generic (PLEG): container finished" podID="fcb9fd4a-b1c0-45a4-9d75-659c49962818" containerID="d8d6558bcfc8f8a36912c9496e9f835e91c0120ac3b2002fd1a896ebba8c8c42" exitCode=0 Jul 15 23:12:51.853062 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:51.852858 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665078652336" event={"ID":"fcb9fd4a-b1c0-45a4-9d75-659c49962818","Type":"ContainerDied","Data":"d8d6558bcfc8f8a36912c9496e9f835e91c0120ac3b2002fd1a896ebba8c8c42"} Jul 15 23:12:52.999350 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:52.999322 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.018432 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.018393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665078652336_fcb9fd4a-b1c0-45a4-9d75-659c49962818/test-curl-7334-139665078652336/0.log" Jul 15 23:12:53.040664 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.040613 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:53.042789 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.042759 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:53.163280 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.163194 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:53.163724 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.163708 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb9fd4a-b1c0-45a4-9d75-659c49962818" containerName="test-curl-7334-139665078652336" Jul 15 23:12:53.163767 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.163729 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb9fd4a-b1c0-45a4-9d75-659c49962818" containerName="test-curl-7334-139665078652336" Jul 15 23:12:53.163842 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.163830 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb9fd4a-b1c0-45a4-9d75-659c49962818" containerName="test-curl-7334-139665078652336" Jul 15 23:12:53.167115 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.167098 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.171644 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.171617 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:53.177582 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.177562 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48m6r\" (UniqueName: \"kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r\") pod \"fcb9fd4a-b1c0-45a4-9d75-659c49962818\" (UID: \"fcb9fd4a-b1c0-45a4-9d75-659c49962818\") " Jul 15 23:12:53.180084 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.180059 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r" (OuterVolumeSpecName: "kube-api-access-48m6r") pod "fcb9fd4a-b1c0-45a4-9d75-659c49962818" (UID: "fcb9fd4a-b1c0-45a4-9d75-659c49962818"). InnerVolumeSpecName "kube-api-access-48m6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:12:53.279385 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.279346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xql2\" (UniqueName: \"kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2\") pod \"test-curl-7334-139665078652336\" (UID: \"5c1ad865-6f19-47bb-8957-3fabb5df0a30\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.279591 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.279513 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48m6r\" (UniqueName: \"kubernetes.io/projected/fcb9fd4a-b1c0-45a4-9d75-659c49962818-kube-api-access-48m6r\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:12:53.380222 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.380172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xql2\" (UniqueName: \"kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2\") pod \"test-curl-7334-139665078652336\" (UID: \"5c1ad865-6f19-47bb-8957-3fabb5df0a30\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.388707 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.388672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xql2\" (UniqueName: \"kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2\") pod \"test-curl-7334-139665078652336\" (UID: \"5c1ad865-6f19-47bb-8957-3fabb5df0a30\") " pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.404308 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.404276 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcb9fd4a-b1c0-45a4-9d75-659c49962818" path="/var/lib/kubelet/pods/fcb9fd4a-b1c0-45a4-9d75-659c49962818/volumes" Jul 15 23:12:53.477939 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.477879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:53.617322 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.617292 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:53.619343 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:53.619313 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c1ad865_6f19_47bb_8957_3fabb5df0a30.slice/crio-1371b24020f59ef35c154e4136b29a88031c9d3e335db5cf41e24c811dad8daa WatchSource:0}: Error finding container 1371b24020f59ef35c154e4136b29a88031c9d3e335db5cf41e24c811dad8daa: Status 404 returned error can't find the container with id 1371b24020f59ef35c154e4136b29a88031c9d3e335db5cf41e24c811dad8daa Jul 15 23:12:53.865120 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.865023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665078652336" event={"ID":"5c1ad865-6f19-47bb-8957-3fabb5df0a30","Type":"ContainerStarted","Data":"1371b24020f59ef35c154e4136b29a88031c9d3e335db5cf41e24c811dad8daa"} Jul 15 23:12:53.866361 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.866342 2556 scope.go:117] "RemoveContainer" containerID="d8d6558bcfc8f8a36912c9496e9f835e91c0120ac3b2002fd1a896ebba8c8c42" Jul 15 23:12:53.866361 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:53.866360 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:54.873724 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:54.873677 2556 generic.go:356] "Generic (PLEG): container finished" podID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" containerID="5475c0e2321b7466735d95b7d8015158b0b62162a7b11dbdd8cc7f5a1e33d99c" exitCode=0 Jul 15 23:12:54.874133 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:54.873773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665078652336" event={"ID":"5c1ad865-6f19-47bb-8957-3fabb5df0a30","Type":"ContainerDied","Data":"5475c0e2321b7466735d95b7d8015158b0b62162a7b11dbdd8cc7f5a1e33d99c"} Jul 15 23:12:56.025025 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.024992 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:56.043707 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.043680 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665078652336_5c1ad865-6f19-47bb-8957-3fabb5df0a30/test-curl-7334-139665078652336/0.log" Jul 15 23:12:56.065224 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.065181 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:56.068828 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.068800 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665078652336"] Jul 15 23:12:56.185646 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.185555 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:56.186110 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.186095 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" containerName="test-curl-7334-139665078652336" Jul 15 23:12:56.186161 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.186113 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" containerName="test-curl-7334-139665078652336" Jul 15 23:12:56.186196 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.186188 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" containerName="test-curl-7334-139665078652336" Jul 15 23:12:56.189266 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.189248 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:56.193819 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.193784 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:56.208143 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.208108 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xql2\" (UniqueName: \"kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2\") pod \"5c1ad865-6f19-47bb-8957-3fabb5df0a30\" (UID: \"5c1ad865-6f19-47bb-8957-3fabb5df0a30\") " Jul 15 23:12:56.210407 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.210372 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2" (OuterVolumeSpecName: "kube-api-access-9xql2") pod "5c1ad865-6f19-47bb-8957-3fabb5df0a30" (UID: "5c1ad865-6f19-47bb-8957-3fabb5df0a30"). InnerVolumeSpecName "kube-api-access-9xql2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:12:56.309778 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.309737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td479\" (UniqueName: \"kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479\") pod \"test-curl-7334-139665074397664\" (UID: \"51254233-609b-4a39-8eb5-03256ade9804\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:56.310014 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.309891 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xql2\" (UniqueName: \"kubernetes.io/projected/5c1ad865-6f19-47bb-8957-3fabb5df0a30-kube-api-access-9xql2\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:12:56.410639 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.410590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td479\" (UniqueName: \"kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479\") pod \"test-curl-7334-139665074397664\" (UID: \"51254233-609b-4a39-8eb5-03256ade9804\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:56.419364 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.419332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td479\" (UniqueName: \"kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479\") pod \"test-curl-7334-139665074397664\" (UID: \"51254233-609b-4a39-8eb5-03256ade9804\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:56.500037 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.500006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:56.644668 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.644640 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:56.647046 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:56.647018 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51254233_609b_4a39_8eb5_03256ade9804.slice/crio-e8bf628ce94a938309026295a46a128a4c0dbc66a105beb82ecee5b27d5d7d90 WatchSource:0}: Error finding container e8bf628ce94a938309026295a46a128a4c0dbc66a105beb82ecee5b27d5d7d90: Status 404 returned error can't find the container with id e8bf628ce94a938309026295a46a128a4c0dbc66a105beb82ecee5b27d5d7d90 Jul 15 23:12:56.886998 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.886875 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:56.886998 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.886937 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1371b24020f59ef35c154e4136b29a88031c9d3e335db5cf41e24c811dad8daa" Jul 15 23:12:56.888195 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:56.888167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074397664" event={"ID":"51254233-609b-4a39-8eb5-03256ade9804","Type":"ContainerStarted","Data":"e8bf628ce94a938309026295a46a128a4c0dbc66a105beb82ecee5b27d5d7d90"} Jul 15 23:12:56.897508 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:12:56.897478 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7334-139665078652336\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:57.403272 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:12:57.403227 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7334-139665078652336\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" pod="opendatahub/test-curl-7334-139665078652336" Jul 15 23:12:57.405670 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:57.405646 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1ad865-6f19-47bb-8957-3fabb5df0a30" path="/var/lib/kubelet/pods/5c1ad865-6f19-47bb-8957-3fabb5df0a30/volumes" Jul 15 23:12:57.895976 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:57.895942 2556 generic.go:356] "Generic (PLEG): container finished" podID="51254233-609b-4a39-8eb5-03256ade9804" containerID="00dc36197a399005bd1a541ee02b5c28f4b314ffa70fea1a6d22c239487317bc" exitCode=0 Jul 15 23:12:57.896164 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:57.896040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074397664" event={"ID":"51254233-609b-4a39-8eb5-03256ade9804","Type":"ContainerDied","Data":"00dc36197a399005bd1a541ee02b5c28f4b314ffa70fea1a6d22c239487317bc"} Jul 15 23:12:59.048751 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.048724 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.067662 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.067634 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665074397664_51254233-609b-4a39-8eb5-03256ade9804/test-curl-7334-139665074397664/0.log" Jul 15 23:12:59.088422 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.088378 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:59.091993 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.091966 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:59.203965 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.203873 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:59.204366 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.204350 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51254233-609b-4a39-8eb5-03256ade9804" containerName="test-curl-7334-139665074397664" Jul 15 23:12:59.204413 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.204367 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="51254233-609b-4a39-8eb5-03256ade9804" containerName="test-curl-7334-139665074397664" Jul 15 23:12:59.204445 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.204432 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="51254233-609b-4a39-8eb5-03256ade9804" containerName="test-curl-7334-139665074397664" Jul 15 23:12:59.207541 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.207526 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.214519 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.214490 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:59.240853 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.240816 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td479\" (UniqueName: \"kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479\") pod \"51254233-609b-4a39-8eb5-03256ade9804\" (UID: \"51254233-609b-4a39-8eb5-03256ade9804\") " Jul 15 23:12:59.243120 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.243095 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479" (OuterVolumeSpecName: "kube-api-access-td479") pod "51254233-609b-4a39-8eb5-03256ade9804" (UID: "51254233-609b-4a39-8eb5-03256ade9804"). InnerVolumeSpecName "kube-api-access-td479". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:12:59.341825 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.341789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7cg\" (UniqueName: \"kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg\") pod \"test-curl-7334-139665074397664\" (UID: \"34a1f0ae-824f-4880-a17c-84e6e787871e\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.342040 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.341929 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td479\" (UniqueName: \"kubernetes.io/projected/51254233-609b-4a39-8eb5-03256ade9804-kube-api-access-td479\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:12:59.410341 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.410301 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51254233-609b-4a39-8eb5-03256ade9804" path="/var/lib/kubelet/pods/51254233-609b-4a39-8eb5-03256ade9804/volumes" Jul 15 23:12:59.443519 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.443482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7cg\" (UniqueName: \"kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg\") pod \"test-curl-7334-139665074397664\" (UID: \"34a1f0ae-824f-4880-a17c-84e6e787871e\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.451774 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.451747 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7cg\" (UniqueName: \"kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg\") pod \"test-curl-7334-139665074397664\" (UID: \"34a1f0ae-824f-4880-a17c-84e6e787871e\") " pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.518213 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.518173 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.683085 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.683059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:12:59.685847 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:12:59.685819 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34a1f0ae_824f_4880_a17c_84e6e787871e.slice/crio-1404962beaac1ab7d1014c6085a8cb62314e510bae09579ac9e4cb7934f76ede WatchSource:0}: Error finding container 1404962beaac1ab7d1014c6085a8cb62314e510bae09579ac9e4cb7934f76ede: Status 404 returned error can't find the container with id 1404962beaac1ab7d1014c6085a8cb62314e510bae09579ac9e4cb7934f76ede Jul 15 23:12:59.908328 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.908246 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:12:59.908328 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.908276 2556 scope.go:117] "RemoveContainer" containerID="00dc36197a399005bd1a541ee02b5c28f4b314ffa70fea1a6d22c239487317bc" Jul 15 23:12:59.909710 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:12:59.909682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074397664" event={"ID":"34a1f0ae-824f-4880-a17c-84e6e787871e","Type":"ContainerStarted","Data":"1404962beaac1ab7d1014c6085a8cb62314e510bae09579ac9e4cb7934f76ede"} Jul 15 23:13:00.917546 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:00.917509 2556 generic.go:356] "Generic (PLEG): container finished" podID="34a1f0ae-824f-4880-a17c-84e6e787871e" containerID="b8dc3328c5646d4b56fda03cb7152752e218a8a36458c3cef65bdfbe1950f989" exitCode=0 Jul 15 23:13:00.917950 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:00.917553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7334-139665074397664" event={"ID":"34a1f0ae-824f-4880-a17c-84e6e787871e","Type":"ContainerDied","Data":"b8dc3328c5646d4b56fda03cb7152752e218a8a36458c3cef65bdfbe1950f989"} Jul 15 23:13:02.077090 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.077054 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:13:02.095732 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.095698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7334-139665074397664_34a1f0ae-824f-4880-a17c-84e6e787871e/test-curl-7334-139665074397664/0.log" Jul 15 23:13:02.117532 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.117491 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:13:02.119506 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.119477 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7334-139665074397664"] Jul 15 23:13:02.168591 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.168554 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k7cg\" (UniqueName: \"kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg\") pod \"34a1f0ae-824f-4880-a17c-84e6e787871e\" (UID: \"34a1f0ae-824f-4880-a17c-84e6e787871e\") " Jul 15 23:13:02.170868 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.170828 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg" (OuterVolumeSpecName: "kube-api-access-7k7cg") pod "34a1f0ae-824f-4880-a17c-84e6e787871e" (UID: "34a1f0ae-824f-4880-a17c-84e6e787871e"). InnerVolumeSpecName "kube-api-access-7k7cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:13:02.269484 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.269449 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k7cg\" (UniqueName: \"kubernetes.io/projected/34a1f0ae-824f-4880-a17c-84e6e787871e-kube-api-access-7k7cg\") on node \"ip-10-0-139-147.ec2.internal\" DevicePath \"\"" Jul 15 23:13:02.931212 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.931186 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:13:02.931387 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:02.931218 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1404962beaac1ab7d1014c6085a8cb62314e510bae09579ac9e4cb7934f76ede" Jul 15 23:13:02.940668 ip-10-0-139-147 kubenswrapper[2556]: E0715 23:13:02.940639 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7334-139665074397664\" is forbidden: User \"system:node:ip-10-0-139-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-147.ec2.internal' and this object" podUID="34a1f0ae-824f-4880-a17c-84e6e787871e" pod="opendatahub/test-curl-7334-139665074397664" Jul 15 23:13:03.404368 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:03.404330 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a1f0ae-824f-4880-a17c-84e6e787871e" path="/var/lib/kubelet/pods/34a1f0ae-824f-4880-a17c-84e6e787871e/volumes" Jul 15 23:13:21.468197 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:21.468163 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6986b46494-psbd6_33a3db41-54bf-4ec2-9954-54c9ebfdae5f/manager/0.log" Jul 15 23:13:21.932563 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:21.932487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-6ch8f_4488d486-0ebb-4ee1-95fb-da80f1178a42/copy-manifests/0.log" Jul 15 23:13:21.938525 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:21.938502 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-6ch8f_4488d486-0ebb-4ee1-95fb-da80f1178a42/manager/0.log" Jul 15 23:13:22.394568 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:22.394538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8548fc8f44-qvz4x_6b6f6d72-ec6d-4da6-9aa4-5aea08dc2a2e/maas-api/0.log" Jul 15 23:13:22.505428 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:22.505395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-5d538e1f-5fb9f56974-nnn6k_fc35b9b7-1789-4a52-93ec-5a95367f7a78/maas-api/0.log" Jul 15 23:13:22.725954 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:22.725924 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-e81434-566f584d7f-qwwvw_4b73a099-5f98-4c55-acae-fa5c1585df6e/maas-api/0.log" Jul 15 23:13:22.841714 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:22.841680 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-ccc4377e-6c475dd947-hcfhw_bd9da65a-d0b0-42f3-8695-3a885f308f13/maas-api/0.log" Jul 15 23:13:23.171786 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:23.171700 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-56f79d48-7dc679456c-4vxg7_01593f34-2fea-4515-bdc4-c452b2f5b2ae/maas-api/0.log" Jul 15 23:13:23.504568 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:23.504536 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-c6dbd3-788d7fb665-x6lks_597c3fcf-3339-48e3-97e5-ae17040a8b9d/maas-api/0.log" Jul 15 23:13:24.037230 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:24.037195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tx7fc_04ad6c88-59dc-445b-9e6f-db01eb2292b5/postgres/0.log" Jul 15 23:13:25.490775 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:25.490743 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wqrdn_912798a4-bd7e-4afe-b19c-23073dd97d6a/manager/0.log" Jul 15 23:13:26.630420 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:26.630380 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69cf9c9cdb-6ddf2_8e111012-c861-49d1-aafc-743b2bf400fd/kube-auth-proxy/0.log" Jul 15 23:13:26.972256 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:26.972222 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v4xld_57b430ac-20b5-4496-ad66-870c48ee3570/payload-pre-processing/0.log" Jul 15 23:13:27.085011 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:27.084966 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q9g24_b6cef660-2539-4188-aaa0-dda5585135bc/payload-processing/0.log" Jul 15 23:13:27.540310 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:27.540282 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:13:27.554093 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:27.554067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:13:27.656012 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:27.655980 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2vmfr_09d7ede3-ec0e-48b8-95da-fe20ba6a66b3/main/0.log" Jul 15 23:13:27.982797 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:27.982769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8mwkq_07a3455b-c9f0-4371-ac51-4cae2a176a9c/main/0.log" Jul 15 23:13:36.349844 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:36.349800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q7ggw_dd148f3b-d3cc-438d-9f9f-4a9bcd20e2d4/global-pull-secret-syncer/0.log" Jul 15 23:13:36.431714 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:36.431680 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fr6zt_3e82cf6d-9b0f-49a0-929e-b00336a2b395/konnectivity-agent/0.log" Jul 15 23:13:36.524340 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:36.524311 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-147.ec2.internal_9fa1b573b1bff3bbe3f49d2310b1a627/haproxy/0.log" Jul 15 23:13:40.996792 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:40.996754 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wqrdn_912798a4-bd7e-4afe-b19c-23073dd97d6a/manager/0.log" Jul 15 23:13:42.912841 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:42.912753 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/alertmanager/0.log" Jul 15 23:13:42.936722 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:42.936688 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/config-reloader/0.log" Jul 15 23:13:42.960810 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:42.960779 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/kube-rbac-proxy-web/0.log" Jul 15 23:13:42.983932 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:42.983891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/kube-rbac-proxy/0.log" Jul 15 23:13:43.003079 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.003049 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/kube-rbac-proxy-metric/0.log" Jul 15 23:13:43.024885 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.024848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/prom-label-proxy/0.log" Jul 15 23:13:43.044855 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.044824 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c4846d5-f656-425c-8a6d-d5dd90f8423c/init-config-reloader/0.log" Jul 15 23:13:43.119984 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.119951 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tfs7w_0c499bf3-fd2e-4c84-9036-58078ad9e96b/kube-state-metrics/0.log" Jul 15 23:13:43.137002 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.136973 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tfs7w_0c499bf3-fd2e-4c84-9036-58078ad9e96b/kube-rbac-proxy-main/0.log" Jul 15 23:13:43.166436 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.166355 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tfs7w_0c499bf3-fd2e-4c84-9036-58078ad9e96b/kube-rbac-proxy-self/0.log" Jul 15 23:13:43.191191 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.191161 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5878db4587-d7h5w_845c202b-391b-402a-9dcb-340e38265a6b/metrics-server/0.log" Jul 15 23:13:43.221426 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.221392 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-b9g7c_96744e76-2b4f-44ea-bbbb-f1113313616a/monitoring-plugin/0.log" Jul 15 23:13:43.253016 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.252987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqsz5_c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5/node-exporter/0.log" Jul 15 23:13:43.271371 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.271345 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqsz5_c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5/kube-rbac-proxy/0.log" Jul 15 23:13:43.291543 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.291516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqsz5_c4c3e8da-9bf6-4a1b-be09-266a57d8b7c5/init-textfile/0.log" Jul 15 23:13:43.467561 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.467509 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2m45c_ccb3a6f7-7ee4-4a01-94d6-028889fcdf12/kube-rbac-proxy-main/0.log" Jul 15 23:13:43.486874 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.486842 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2m45c_ccb3a6f7-7ee4-4a01-94d6-028889fcdf12/kube-rbac-proxy-self/0.log" Jul 15 23:13:43.507581 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.507556 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2m45c_ccb3a6f7-7ee4-4a01-94d6-028889fcdf12/openshift-state-metrics/0.log" Jul 15 23:13:43.547892 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.547863 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/prometheus/0.log" Jul 15 23:13:43.568134 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.568089 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/config-reloader/0.log" Jul 15 23:13:43.590205 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.590178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/thanos-sidecar/0.log" Jul 15 23:13:43.617433 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.617409 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/kube-rbac-proxy-web/0.log" Jul 15 23:13:43.643444 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.643419 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/kube-rbac-proxy/0.log" Jul 15 23:13:43.663776 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.663751 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/kube-rbac-proxy-thanos/0.log" Jul 15 23:13:43.683691 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.683665 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2ba1d514-898c-4ac1-9e24-23daa51b01ec/init-config-reloader/0.log" Jul 15 23:13:43.712472 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.712447 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-l4xs6_69fcfd51-fc64-4d66-89cb-1e7c68938c1c/prometheus-operator/0.log" Jul 15 23:13:43.731599 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.731516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-l4xs6_69fcfd51-fc64-4d66-89cb-1e7c68938c1c/kube-rbac-proxy/0.log" Jul 15 23:13:43.755606 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.755550 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-skszg_1a78073b-2b86-4016-a65a-a085869aa9ec/prometheus-operator-admission-webhook/0.log" Jul 15 23:13:43.784656 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.784629 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d85497f-txdgg_70299c0b-af28-46bb-90cb-765b24d8321c/telemeter-client/0.log" Jul 15 23:13:43.811858 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.811819 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d85497f-txdgg_70299c0b-af28-46bb-90cb-765b24d8321c/reload/0.log" Jul 15 23:13:43.840391 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.840361 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-95d85497f-txdgg_70299c0b-af28-46bb-90cb-765b24d8321c/kube-rbac-proxy/0.log" Jul 15 23:13:43.874161 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.874118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/thanos-query/0.log" Jul 15 23:13:43.895211 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.895185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/kube-rbac-proxy-web/0.log" Jul 15 23:13:43.917830 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.917793 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/kube-rbac-proxy/0.log" Jul 15 23:13:43.942888 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.942855 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/prom-label-proxy/0.log" Jul 15 23:13:43.966179 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.966151 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/kube-rbac-proxy-rules/0.log" Jul 15 23:13:43.987765 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:43.987660 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59689dcdb7-4gpjh_b4292db1-557d-4c0f-a001-ac5d1e8f5ae5/kube-rbac-proxy-metrics/0.log" Jul 15 23:13:46.850457 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:46.850427 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c565dcc8c-zpm7r_13a3bc95-6c08-450b-8a74-bc21330586f2/console/0.log" Jul 15 23:13:46.881581 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:46.881545 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-kv8vz_6526eb58-99eb-403b-b5e2-f991e790892d/download-server/0.log" Jul 15 23:13:48.477313 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:48.477237 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-77fqf_894cdc27-c852-468b-a9e8-76f609388a7d/dns/0.log" Jul 15 23:13:48.496614 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:48.496584 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-77fqf_894cdc27-c852-468b-a9e8-76f609388a7d/kube-rbac-proxy/0.log" Jul 15 23:13:48.610309 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:48.610278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b7d2d_d222974c-6afe-4950-97c6-1c036daceeea/dns-node-resolver/0.log" Jul 15 23:13:49.192883 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:49.192838 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gfkwh_efee81a9-e685-4bb5-8af5-1e9cee654f42/node-ca/0.log" Jul 15 23:13:50.277218 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.277171 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69cf9c9cdb-6ddf2_8e111012-c861-49d1-aafc-743b2bf400fd/kube-auth-proxy/0.log" Jul 15 23:13:50.397209 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.397180 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v4xld_57b430ac-20b5-4496-ad66-870c48ee3570/payload-pre-processing/0.log" Jul 15 23:13:50.407633 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.407605 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v"] Jul 15 23:13:50.408122 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.408107 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a1f0ae-824f-4880-a17c-84e6e787871e" containerName="test-curl-7334-139665074397664" Jul 15 23:13:50.408180 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.408124 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a1f0ae-824f-4880-a17c-84e6e787871e" containerName="test-curl-7334-139665074397664" Jul 15 23:13:50.408226 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.408216 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a1f0ae-824f-4880-a17c-84e6e787871e" containerName="test-curl-7334-139665074397664" Jul 15 23:13:50.411610 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.411593 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.414053 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.414030 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh22x\"/\"default-dockercfg-77s8m\"" Jul 15 23:13:50.414160 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.414070 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh22x\"/\"kube-root-ca.crt\"" Jul 15 23:13:50.415168 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.415131 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh22x\"/\"openshift-service-ca.crt\"" Jul 15 23:13:50.417874 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.417856 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v"] Jul 15 23:13:50.434576 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.434547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-sys\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.434733 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.434607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-proc\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.434733 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.434632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-lib-modules\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.434733 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.434678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-podres\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.434953 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.434733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869ws\" (UniqueName: \"kubernetes.io/projected/cbf67eee-312e-473e-9295-4b380fdac347-kube-api-access-869ws\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.441785 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.441763 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q9g24_b6cef660-2539-4188-aaa0-dda5585135bc/payload-processing/0.log" Jul 15 23:13:50.535443 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869ws\" (UniqueName: \"kubernetes.io/projected/cbf67eee-312e-473e-9295-4b380fdac347-kube-api-access-869ws\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535443 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-sys\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-proc\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-lib-modules\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535567 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-sys\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-podres\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535606 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-lib-modules\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535678 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535567 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-proc\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.535872 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.535699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbf67eee-312e-473e-9295-4b380fdac347-podres\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.543434 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.543406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-869ws\" (UniqueName: \"kubernetes.io/projected/cbf67eee-312e-473e-9295-4b380fdac347-kube-api-access-869ws\") pod \"perf-node-gather-daemonset-7fg4v\" (UID: \"cbf67eee-312e-473e-9295-4b380fdac347\") " pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.722586 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.722548 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:50.863340 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:50.863306 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v"] Jul 15 23:13:50.867071 ip-10-0-139-147 kubenswrapper[2556]: W0715 23:13:50.867029 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbf67eee_312e_473e_9295_4b380fdac347.slice/crio-8cafe7a74020448b11503842773d7d6530522674da3c0ed2fefd07341669e222 WatchSource:0}: Error finding container 8cafe7a74020448b11503842773d7d6530522674da3c0ed2fefd07341669e222: Status 404 returned error can't find the container with id 8cafe7a74020448b11503842773d7d6530522674da3c0ed2fefd07341669e222 Jul 15 23:13:51.181259 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.181178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmgs4_00ff2d6e-47b3-40f8-ad37-2691ca6165dd/serve-healthcheck-canary/0.log" Jul 15 23:13:51.193608 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.193576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" event={"ID":"cbf67eee-312e-473e-9295-4b380fdac347","Type":"ContainerStarted","Data":"fd6108c7cf94b59ba1c4a56aae13950f73d873b7fb48e1626b2bdcefd3008e9c"} Jul 15 23:13:51.193797 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.193628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" event={"ID":"cbf67eee-312e-473e-9295-4b380fdac347","Type":"ContainerStarted","Data":"8cafe7a74020448b11503842773d7d6530522674da3c0ed2fefd07341669e222"} Jul 15 23:13:51.193797 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.193666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:51.209686 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.209631 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" podStartSLOduration=1.209614765 podStartE2EDuration="1.209614765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:13:51.208115936 +0000 UTC m=+2424.298767179" watchObservedRunningTime="2026-07-15 23:13:51.209614765 +0000 UTC m=+2424.300266008" Jul 15 23:13:51.750575 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.750514 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz28d_2e50e605-1e35-45da-908b-30a50d18cb95/kube-rbac-proxy/0.log" Jul 15 23:13:51.771530 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.771497 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz28d_2e50e605-1e35-45da-908b-30a50d18cb95/exporter/0.log" Jul 15 23:13:51.791440 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:51.791415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz28d_2e50e605-1e35-45da-908b-30a50d18cb95/extractor/0.log" Jul 15 23:13:54.170827 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:54.170780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6986b46494-psbd6_33a3db41-54bf-4ec2-9954-54c9ebfdae5f/manager/0.log" Jul 15 23:13:54.335426 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:54.335390 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-6ch8f_4488d486-0ebb-4ee1-95fb-da80f1178a42/manager/0.log" Jul 15 23:13:54.357619 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:54.357587 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7db6597b7c-6ch8f_4488d486-0ebb-4ee1-95fb-da80f1178a42/copy-manifests/0.log" Jul 15 23:13:55.624569 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:55.624541 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf7bf55db-pk4q7_1f39d73c-4676-46dc-ba7b-81d0c744e264/manager/0.log" Jul 15 23:13:56.877734 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:56.877702 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69cf9c9cdb-6ddf2_8e111012-c861-49d1-aafc-743b2bf400fd/kube-auth-proxy/0.log" Jul 15 23:13:56.956741 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:56.956707 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v4xld_57b430ac-20b5-4496-ad66-870c48ee3570/payload-pre-processing/0.log" Jul 15 23:13:56.976752 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:56.976718 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q9g24_b6cef660-2539-4188-aaa0-dda5585135bc/payload-processing/0.log" Jul 15 23:13:57.210048 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:57.210018 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh22x/perf-node-gather-daemonset-7fg4v" Jul 15 23:13:58.190115 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:58.190084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69cf9c9cdb-6ddf2_8e111012-c861-49d1-aafc-743b2bf400fd/kube-auth-proxy/0.log" Jul 15 23:13:58.283890 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:58.283854 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v4xld_57b430ac-20b5-4496-ad66-870c48ee3570/payload-pre-processing/0.log" Jul 15 23:13:58.304239 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:13:58.304208 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q9g24_b6cef660-2539-4188-aaa0-dda5585135bc/payload-processing/0.log" Jul 15 23:14:02.254059 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.254027 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/kube-multus-additional-cni-plugins/0.log" Jul 15 23:14:02.274334 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.274305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/egress-router-binary-copy/0.log" Jul 15 23:14:02.293986 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.293960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/cni-plugins/0.log" Jul 15 23:14:02.313475 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.313448 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/bond-cni-plugin/0.log" Jul 15 23:14:02.335830 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.335802 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/routeoverride-cni/0.log" Jul 15 23:14:02.356702 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.356676 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/whereabouts-cni-bincopy/0.log" Jul 15 23:14:02.377105 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.377077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpv6x_f761c195-7c70-4aeb-91e3-08323df18fbf/whereabouts-cni/0.log" Jul 15 23:14:02.623644 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.623555 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xpwbt_5aea217f-627d-427d-9b70-2fb27ff841d2/kube-multus/0.log" Jul 15 23:14:02.644675 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.644648 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dlpr2_69fa51a1-f78c-4236-9de4-d35f40fb4ff5/network-metrics-daemon/0.log" Jul 15 23:14:02.665947 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:02.665885 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dlpr2_69fa51a1-f78c-4236-9de4-d35f40fb4ff5/kube-rbac-proxy/0.log" Jul 15 23:14:04.190940 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.190894 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-controller/0.log" Jul 15 23:14:04.208287 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.208250 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/0.log" Jul 15 23:14:04.209411 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.209388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovn-acl-logging/1.log" Jul 15 23:14:04.225394 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.225365 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/kube-rbac-proxy-node/0.log" Jul 15 23:14:04.244994 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.244969 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/kube-rbac-proxy-ovn-metrics/0.log" Jul 15 23:14:04.264510 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.264479 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/northd/0.log" Jul 15 23:14:04.284106 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.284073 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/nbdb/0.log" Jul 15 23:14:04.306212 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.306186 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/sbdb/0.log" Jul 15 23:14:04.353573 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:04.353543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wcj56_cbf5c601-7dc1-444e-9c5a-9ef0621352ba/ovnkube-controller/0.log" Jul 15 23:14:05.472110 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:05.472069 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-74kgh_a82af034-adb2-404d-af19-226f8702524e/network-check-target-container/0.log" Jul 15 23:14:06.561292 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:06.561266 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sps6d_72346f4a-319e-4c58-8b6b-dbe158fb47ab/iptables-alerter/0.log" Jul 15 23:14:07.320141 ip-10-0-139-147 kubenswrapper[2556]: I0715 23:14:07.320100 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rl8dg_b516762b-6669-4fdb-8b4a-614bd60dfd6e/tuned/0.log"