Jul 07 17:34:27.313296 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 17:34:27.313312 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 17:34:27.313324 ip-10-0-134-236 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 17:34:27.313668 ip-10-0-134-236 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 17:34:37.433449 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 17:34:37.433465 ip-10-0-134-236 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot da1ac4e19c7f43789bcb83f7494ea0ac -- Jul 07 17:36:35.773235 ip-10-0-134-236 systemd[1]: Starting Kubernetes Kubelet... Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.168762 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.175959 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176099 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176103 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176107 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176110 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176112 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176115 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.184624 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176120 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176124 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176127 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176130 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176133 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176136 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176139 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176141 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176144 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176147 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176151 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176154 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176157 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176160 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176163 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176165 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176168 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176171 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176174 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176176 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.185457 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176179 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176182 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176185 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176188 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176190 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176194 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176200 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176203 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176206 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176209 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176213 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176217 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176220 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176223 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176225 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176228 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176231 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176234 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176237 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176239 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.186077 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176242 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176244 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176247 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176249 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176252 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176255 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176257 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176260 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176263 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176265 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176268 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176270 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176273 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176275 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176278 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176280 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176283 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176285 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176288 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176291 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.186693 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176294 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176299 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176302 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176305 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176308 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176311 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176313 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176316 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176320 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176324 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176327 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176330 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176333 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176336 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176339 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176342 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176354 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176357 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176360 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.187275 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176362 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176365 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176368 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176371 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176373 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176377 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176379 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176382 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176384 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176387 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176390 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176393 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.176395 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177156 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177164 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177167 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177169 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177172 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177175 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177177 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177180 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.187775 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177182 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177188 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177192 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177195 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177198 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177201 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177204 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177207 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177210 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177220 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177223 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177225 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177228 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177230 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177233 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177236 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177239 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177241 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177244 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177247 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.188427 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177249 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177252 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177254 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177256 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177259 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177262 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177265 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177267 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177271 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177273 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177276 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177278 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177281 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177284 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177287 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177289 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177292 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177295 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177297 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177300 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.188966 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177302 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177305 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177308 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177312 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177315 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177317 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177320 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177323 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177325 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177328 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177331 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177336 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177338 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177341 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177343 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177347 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177351 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177354 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177357 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.189531 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177359 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177362 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177364 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177369 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177373 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177376 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177380 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177383 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177385 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177388 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177391 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177394 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177397 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177399 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177402 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177404 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177407 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177410 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177412 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177415 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.190048 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177418 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177421 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177423 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177426 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177429 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177432 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177434 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177437 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177440 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177442 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177444 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177447 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177845 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177850 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177853 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177856 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177858 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177863 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177867 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.190640 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177871 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177875 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177878 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177881 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177884 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177887 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177890 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177892 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177895 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177898 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177901 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177922 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177925 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177928 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177930 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177933 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177936 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177940 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177943 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177946 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.191584 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177948 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177951 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177954 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177956 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177959 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177961 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177964 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177966 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177969 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177972 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177974 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177977 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177979 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177982 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177985 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177987 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177990 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177992 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177995 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.177998 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.192628 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178001 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178004 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178008 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178011 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178013 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178016 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178018 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178021 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178024 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178029 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178032 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178035 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178038 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178040 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178043 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178045 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178048 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178050 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178052 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.193668 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178055 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178059 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178062 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178065 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178067 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178072 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178075 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178078 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178080 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178083 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178085 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178088 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178090 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178093 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178095 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178097 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178100 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178103 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178106 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178108 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.194692 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178111 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178113 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178117 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178119 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178122 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178125 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178127 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178129 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178132 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178134 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178137 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178139 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178141 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178209 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178216 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178222 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178226 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178232 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178236 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178240 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178245 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 17:36:36.195943 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178248 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178251 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178255 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178258 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178262 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178265 2567 flags.go:64] FLAG: --cgroup-root="" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178268 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178271 2567 flags.go:64] FLAG: --client-ca-file="" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178274 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178277 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178281 2567 flags.go:64] FLAG: --cluster-domain="" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178284 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178287 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178292 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178295 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178299 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178302 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178305 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178308 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178311 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178314 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178317 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178320 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178323 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 17:36:36.196994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178327 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178330 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178333 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178336 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178340 2567 flags.go:64] FLAG: --enable-server="true" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178343 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178348 2567 flags.go:64] FLAG: --event-burst="100" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178351 2567 flags.go:64] FLAG: --event-qps="50" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178354 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178357 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178360 2567 flags.go:64] FLAG: --eviction-hard="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178363 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178366 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178369 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178372 2567 flags.go:64] FLAG: --eviction-soft="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178375 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178378 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178382 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178385 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178388 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178391 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178394 2567 flags.go:64] FLAG: --feature-gates="" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178398 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178401 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178404 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 17:36:36.197784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178407 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178410 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178413 2567 flags.go:64] FLAG: --help="false" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178416 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-134-236.ec2.internal" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178419 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178422 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178425 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178428 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178431 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178434 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178437 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178441 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178444 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178447 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178450 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178453 2567 flags.go:64] FLAG: --kube-reserved="" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178456 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178459 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178462 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178464 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178467 2567 flags.go:64] FLAG: --lock-file="" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178470 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178473 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178476 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 17:36:36.199048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178482 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178486 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178489 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178492 2567 flags.go:64] FLAG: --logging-format="text" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178496 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178500 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178502 2567 flags.go:64] FLAG: --manifest-url="" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178505 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178509 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178512 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178516 2567 flags.go:64] FLAG: --max-pods="110" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178520 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178523 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178526 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178528 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178531 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178534 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178537 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178544 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178548 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178552 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178555 2567 flags.go:64] FLAG: --pod-cidr="" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178557 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 17:36:36.200318 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178563 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178566 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178569 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178571 2567 flags.go:64] FLAG: --port="10250" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178574 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178577 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e35834da4be0191" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178581 2567 flags.go:64] FLAG: --qos-reserved="" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178583 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178586 2567 flags.go:64] FLAG: --register-node="true" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178589 2567 flags.go:64] FLAG: --register-with-taints="" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178593 2567 flags.go:64] FLAG: --registry-burst="10" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178596 2567 flags.go:64] FLAG: --registry-qps="5" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178599 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178604 2567 flags.go:64] FLAG: --reserved-memory="" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178607 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178610 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178613 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178616 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178619 2567 flags.go:64] FLAG: --runonce="false" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178622 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178625 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178628 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178631 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178634 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178637 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178640 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 17:36:36.201061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178643 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178646 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178649 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178653 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178656 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178659 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178662 2567 flags.go:64] FLAG: --system-cgroups="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178665 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178670 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178673 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178676 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178679 2567 flags.go:64] FLAG: --tls-min-version="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178682 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178685 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178688 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178690 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178693 2567 flags.go:64] FLAG: --v="2" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178697 2567 flags.go:64] FLAG: --version="false" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178701 2567 flags.go:64] FLAG: --vmodule="" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178707 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.178710 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178819 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178822 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178825 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.293829 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178828 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.256101 ip-10-0-134-236 systemd[1]: Started Kubernetes Kubelet. Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178830 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178833 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178836 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178839 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178841 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178844 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178847 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178849 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178852 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178854 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178858 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178861 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178864 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178867 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178869 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178872 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178874 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178877 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178879 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.294850 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178882 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178884 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178886 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178889 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178892 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178894 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178896 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178900 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178903 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178923 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178927 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178931 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178934 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178937 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178939 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178942 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178945 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178948 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178950 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.295768 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178953 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178956 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178958 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178961 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178965 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178967 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178970 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178973 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178975 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178978 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178980 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178983 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178986 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178988 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178991 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178993 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.178998 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179001 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179005 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.296513 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179007 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179012 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179015 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179018 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179020 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179023 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179026 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179029 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179031 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179034 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179036 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179039 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179041 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179045 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179048 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179051 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179054 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179058 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179060 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.297179 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179063 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179066 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179069 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179078 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179081 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179084 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179087 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179089 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179092 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179094 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179097 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179099 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179102 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179104 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179108 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179111 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179115 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179117 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.297943 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.179120 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.180407 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.195491 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.195512 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.195542 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.195556 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195647 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195655 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195660 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195665 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195670 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195674 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195678 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195683 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195686 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.298802 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195690 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195694 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195697 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195701 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195704 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195708 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195711 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195715 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195718 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195722 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195725 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195729 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195733 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195736 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195740 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195745 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195748 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195751 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195754 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.299666 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195760 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195764 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195768 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195772 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195776 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195780 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195783 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195786 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195789 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195793 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195796 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195799 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195802 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195806 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195809 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195812 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195815 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195818 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195823 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.300339 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195827 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195831 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195835 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195839 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195842 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195846 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195849 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195852 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195856 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195859 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195870 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195874 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195878 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195882 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195886 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195890 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195894 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195900 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195921 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195926 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.300960 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195930 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195934 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195938 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195942 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195946 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195950 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195954 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195958 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195962 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195966 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195970 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195975 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195979 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195983 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195987 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195991 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.195995 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196000 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196004 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196009 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.301604 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196015 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196021 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196025 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196031 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196035 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196040 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196048 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196052 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196057 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196061 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196066 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.196074 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196254 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196263 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:36.302287 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196268 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196272 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196276 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196281 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196285 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196289 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196294 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196298 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196302 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196306 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196310 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196315 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196319 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196323 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196328 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196332 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196345 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196350 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196357 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196363 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:36.302730 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196368 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196375 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196379 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196384 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196388 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196392 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196397 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196401 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196405 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196409 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196414 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196421 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196426 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196431 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196436 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196440 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196444 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196449 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196454 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:36.303360 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196458 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196462 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196466 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196470 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196474 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196478 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196482 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196486 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196491 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196495 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196499 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196503 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196508 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196513 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196517 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196522 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196526 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196530 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196535 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196540 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:36.304203 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196544 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196549 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196553 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196557 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196561 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196566 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196570 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196574 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196578 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196583 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196587 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196591 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196595 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196599 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196604 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196609 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196614 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196618 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196623 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:36.304831 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196627 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196631 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196638 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196643 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196648 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196653 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196658 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196663 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196668 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196674 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196678 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196683 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196687 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196691 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196695 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196702 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196706 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196710 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:36.305459 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:36.196714 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.196723 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.196891 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.199494 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.200768 2567 server.go:1019] "Starting client certificate rotation" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.200872 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.200925 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.204633 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.210703 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.222710 2567 log.go:25] "Validated CRI v1 runtime API" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.226487 2567 log.go:25] "Validated CRI v1 image API" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.227280 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 17:36:36.306077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.228431 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:36:36.306478 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.230378 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8266997d-ac58-4a89-bbfe-b08cfc3c482c:/dev/nvme0n1p3 ed79cb41-c068-48f5-846a-44f5e69a7562:/dev/nvme0n1p4] Jul 07 17:36:36.306478 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.230398 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.235227 2567 manager.go:216] Machine: {Timestamp:2026-07-07 17:36:36.234072551 +0000 UTC m=+0.343853087 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112900 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2010329bd1fd24afb5afef2dbd322e SystemUUID:ec201032-9bd1-fd24-afb5-afef2dbd322e BootID:da1ac4e1-9c7f-4378-9bcb-83f7494ea0ac Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:66:6b:76:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:66:6b:76:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:5d:7f:39:ba:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.235338 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.235414 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.238883 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.238921 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.239542 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.239552 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.239564 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.240327 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.241403 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245007 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245142 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245170 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245184 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245195 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245205 2567 kubelet.go:398] "Adding apiserver pod source" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245213 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 17:36:36.467355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245545 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.245561 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.247307 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.248989 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.249016 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.249995 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250009 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250015 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250021 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250029 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250035 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250046 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250055 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250062 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250068 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250082 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250087 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250111 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.250119 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.253623 2567 server.go:1268] "Started kubelet" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.253723 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.253771 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.253836 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.256964 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.258131 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.260103 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.260646 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.260647 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263127 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263144 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.263209 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263796 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263796 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263823 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263927 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.263937 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.266841 2567 factory.go:55] Registering systemd factory Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.266852 2567 factory.go:223] Registration of the systemd container factory successfully Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267048 2567 factory.go:153] Registering CRI-O factory Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267059 2567 factory.go:223] Registration of the crio container factory successfully Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267118 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267141 2567 factory.go:103] Registering Raw factory Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267156 2567 manager.go:1196] Started watching for new ooms in manager Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.267279 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.267961 2567 manager.go:349] Starting recovery of all containers Jul 07 17:36:38.593221 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.268707 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.268843 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.268746 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.ec2.internal.18c01280a9dbf258 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.ec2.internal,UID:ip-10-0-134-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.ec2.internal,},FirstTimestamp:2026-07-07 17:36:36.2535942 +0000 UTC m=+0.363374714,LastTimestamp:2026-07-07 17:36:36.2535942 +0000 UTC m=+0.363374714,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.ec2.internal,}" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.271859 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmrfb" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.277119 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmrfb" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.280374 2567 manager.go:354] Recovery completed Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.284275 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286259 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286289 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286301 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286867 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286879 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.286879 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.287003 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.288207 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.ec2.internal.18c01280abce93b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.ec2.internal,UID:ip-10-0-134-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.ec2.internal,},FirstTimestamp:2026-07-07 17:36:36.286272434 +0000 UTC m=+0.396052952,LastTimestamp:2026-07-07 17:36:36.286272434 +0000 UTC m=+0.396052952,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.ec2.internal,}" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.288885 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.289198 2567 policy_none.go:49] "None policy: Start" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.289212 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.289224 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.289362 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.289379 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.291321 2567 policy_none.go:47] "Start" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.326520 2567 manager.go:337] "Starting Device Plugin manager" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.326549 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.326558 2567 server.go:87] "Starting device plugin registration server" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.326804 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.326815 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.326965 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.327098 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.327110 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.327614 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.327664 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.426887 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.598736 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.428042 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.428072 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.428082 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.428108 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.437423 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.437445 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-236.ec2.internal\": node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.460455 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.461565 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.462818 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.462863 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.462889 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:36.462946 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 17:36:38.599822 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:36.464737 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.663322 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.666490 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal"] Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.666577 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.668256 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.668287 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.668298 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670172 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670288 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670320 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670925 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670928 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670949 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670953 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670958 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.670963 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.672780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.672808 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.673413 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.673439 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.673470 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.709295 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-236.ec2.internal\" not found" node="ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.749974 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.713692 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-236.ec2.internal\" not found" node="ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.763689 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.767970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dcb28d9929b3a5ac38ae3cfd207b04c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.ec2.internal\" (UID: \"dcb28d9929b3a5ac38ae3cfd207b04c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.767997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.768017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.864389 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dcb28d9929b3a5ac38ae3cfd207b04c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.ec2.internal\" (UID: \"dcb28d9929b3a5ac38ae3cfd207b04c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dcb28d9929b3a5ac38ae3cfd207b04c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.ec2.internal\" (UID: \"dcb28d9929b3a5ac38ae3cfd207b04c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:38.893007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:38.868830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35162229216d2b61dec8255ff3fc3c97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal\" (UID: \"35162229216d2b61dec8255ff3fc3c97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:39.031825 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:38.964873 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.031825 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.012323 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:39.031825 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.016820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:39.174240 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.065289 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.174240 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.165571 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.304617 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.266071 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.304617 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.303418 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 17:36:39.304617 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.303596 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 17:36:39.439820 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.367692 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.439820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.384181 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:31:38 +0000 UTC" deadline="2028-03-25 19:07:49.830716914 +0000 UTC" Jul 07 17:36:39.439820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.384217 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15049h31m10.446503075s" Jul 07 17:36:39.570599 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.468674 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.570599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.469267 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:39.570599 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:39.569174 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-236.ec2.internal\" not found" Jul 07 17:36:39.695185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.647610 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:39.695185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.666721 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" Jul 07 17:36:39.695185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.678427 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:36:39.695185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.679648 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" Jul 07 17:36:39.695185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.688647 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:36:39.841415 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:39.733439 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb28d9929b3a5ac38ae3cfd207b04c4.slice/crio-7ee882c778d3dd9ac793a525370d5b8af004aa13c22fafad9054261f937861f5 WatchSource:0}: Error finding container 7ee882c778d3dd9ac793a525370d5b8af004aa13c22fafad9054261f937861f5: Status 404 returned error can't find the container with id 7ee882c778d3dd9ac793a525370d5b8af004aa13c22fafad9054261f937861f5 Jul 07 17:36:39.841415 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:39.733835 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35162229216d2b61dec8255ff3fc3c97.slice/crio-e9637826d3ed45232adabd2176422511288c6800564e485f3d021427c2b5a8c3 WatchSource:0}: Error finding container e9637826d3ed45232adabd2176422511288c6800564e485f3d021427c2b5a8c3: Status 404 returned error can't find the container with id e9637826d3ed45232adabd2176422511288c6800564e485f3d021427c2b5a8c3 Jul 07 17:36:39.841415 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.738718 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:36:39.953692 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:39.911162 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:40.320259 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.280909 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:40.355965 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.355934 2567 apiserver.go:52] "Watching apiserver" Jul 07 17:36:40.364064 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.363867 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 17:36:40.364834 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.364365 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-l6szj","kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mfd5s","openshift-dns/node-resolver-6bnfw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal","openshift-network-operator/iptables-alerter-f976l","openshift-ovn-kubernetes/ovnkube-node-7dnpq","kube-system/global-pull-secret-syncer-x6npr","kube-system/konnectivity-agent-qsmhg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt","openshift-image-registry/node-ca-fgpnx","openshift-multus/multus-2csct","openshift-multus/multus-additional-cni-plugins-fl42s","openshift-multus/network-metrics-daemon-5hslb"] Jul 07 17:36:40.367191 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.367169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.367814 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.367786 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 17:36:40.370653 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.370634 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 17:36:40.370766 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.370662 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 17:36:40.370915 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.370896 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.371006 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.370916 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 17:36:40.371062 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.371015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gkttq\"" Jul 07 17:36:40.372322 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.372221 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.372979 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.372674 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 17:36:40.378793 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.378771 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:36:40.378902 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.378857 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.381106 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.381276 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-systemd-units\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381276 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-var-lib-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-node-log\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-log-socket\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-config\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-kubelet\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-netns\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-bin\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-env-overrides\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovn-node-metrics-cert\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-script-lib\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-systemd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-etc-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381564 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381584 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jntd4\"" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-ovn\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.381718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-netd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ead001-dfc6-4b72-bee7-afb093970c49-host\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptm5z\" (UniqueName: \"kubernetes.io/projected/82ead001-dfc6-4b72-bee7-afb093970c49-kube-api-access-ptm5z\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-slash\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjm2\" (UniqueName: \"kubernetes.io/projected/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-kube-api-access-wvjm2\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ead001-dfc6-4b72-bee7-afb093970c49-serviceca\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.382271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.381861 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 17:36:40.383850 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.383830 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.384072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.384054 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2kxnw\"" Jul 07 17:36:40.384143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.384057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.386493 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.385859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.388071 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.387759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.388071 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.387829 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:40.388520 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.388110 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.389032 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.388852 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x78zm\"" Jul 07 17:36:40.389032 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.388919 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.390108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.390089 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.393591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.392182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.393591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.392783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 17:36:40.393591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.392795 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zlz9h\"" Jul 07 17:36:40.393591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.392941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.393591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.393100 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.394902 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.394527 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 17:36:40.395001 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.394918 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 17:36:40.396818 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.395529 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pnxk9\"" Jul 07 17:36:40.396818 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.396162 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.397862 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.397842 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.397943 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.397907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:40.399554 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.399529 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwdwf" Jul 07 17:36:40.399777 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.399759 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.399841 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.399804 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.402479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.400145 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 17:36:40.402479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.400174 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 17:36:40.402479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.400498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k6j82\"" Jul 07 17:36:40.402479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.400681 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.402479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.401745 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 17:36:40.403862 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.403769 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:40.403862 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.403835 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:40.404173 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.404079 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 17:36:40.404173 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.404157 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 17:36:40.404173 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.404164 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5tv8\"" Jul 07 17:36:40.404926 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.404880 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 17:36:40.406163 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.406110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2csct" Jul 07 17:36:40.407353 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.407012 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwdwf" Jul 07 17:36:40.409494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.409133 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hrv6x\"" Jul 07 17:36:40.409494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.409334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 17:36:40.468289 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.468186 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 17:36:40.482615 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-modprobe-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.482615 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8jfs\" (UniqueName: \"kubernetes.io/projected/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-kube-api-access-h8jfs\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-etc-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-netd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.482828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-daemon-config\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h77z\" (UniqueName: \"kubernetes.io/projected/ffe63a58-8548-4c53-b125-2dc2026a881c-kube-api-access-8h77z\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece089c7-eee1-4848-8f25-398f7fd71344-konnectivity-ca\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f10413d-de1c-49b3-abde-673ab0ff4ad6-iptables-alerter-script\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqb2\" (UniqueName: \"kubernetes.io/projected/2f10413d-de1c-49b3-abde-673ab0ff4ad6-kube-api-access-7vqb2\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.482982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-etc-kubernetes\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-systemd-units\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-systemd\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-var-lib-kubelet\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-host\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-tmp-dir\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.483143 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-kubelet\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-kubelet\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483180 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ead001-dfc6-4b72-bee7-afb093970c49-host\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-dbus\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-system-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece089c7-eee1-4848-8f25-398f7fd71344-agent-certs\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-k8s-cni-cncf-io\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-lib-modules\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-tuned\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-os-release\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjm2\" (UniqueName: \"kubernetes.io/projected/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-kube-api-access-wvjm2\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-node-log\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-log-socket\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-os-release\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-bin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.483713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-kubernetes\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-netns\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f10413d-de1c-49b3-abde-673ab0ff4ad6-host-slash\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-netns\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-hosts-file\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-systemd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptm5z\" (UniqueName: \"kubernetes.io/projected/82ead001-dfc6-4b72-bee7-afb093970c49-kube-api-access-ptm5z\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483839 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcbw\" (UniqueName: \"kubernetes.io/projected/808da2c9-ea61-4b90-815f-4aa81b55cb44-kube-api-access-wrcbw\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-cnibin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-hostroot\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-slash\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.483994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-kubelet-config\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-conf\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.484518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484254 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-cnibin\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-systemd-units\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-slash\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-cni-binary-copy\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-netd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-kubelet\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-node-log\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-socket-dir-parent\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484369 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-etc-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-netns\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-log-socket\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-systemd\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ead001-dfc6-4b72-bee7-afb093970c49-host\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.485231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovn-node-metrics-cert\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysconfig\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-ovn\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.484982 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-run-ovn\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-run\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-system-cni-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n26bp\" (UniqueName: \"kubernetes.io/projected/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kube-api-access-n26bp\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-conf-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485160 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-tmp\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-multus\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ead001-dfc6-4b72-bee7-afb093970c49-serviceca\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.486027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-var-lib-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-config\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-multus-certs\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-sys\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrk5d\" (UniqueName: \"kubernetes.io/projected/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-kube-api-access-nrk5d\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4rt\" (UniqueName: \"kubernetes.io/projected/5676bc7b-8173-4401-ac13-0fb155cdba80-kube-api-access-vs4rt\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485563 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-bin\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-env-overrides\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-script-lib\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-device-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485759 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ead001-dfc6-4b72-bee7-afb093970c49-serviceca\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485772 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-host-cni-bin\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-config\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.485965 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-var-lib-openvswitch\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.486141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-env-overrides\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.486843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.486265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovnkube-script-lib\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.488844 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.488793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-ovn-node-metrics-cert\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.492843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.492824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptm5z\" (UniqueName: \"kubernetes.io/projected/82ead001-dfc6-4b72-bee7-afb093970c49-kube-api-access-ptm5z\") pod \"node-ca-fgpnx\" (UID: \"82ead001-dfc6-4b72-bee7-afb093970c49\") " pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.493095 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.493075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjm2\" (UniqueName: \"kubernetes.io/projected/9282ff21-e3a5-4faf-b52f-cba5853d8f6a-kube-api-access-wvjm2\") pod \"ovnkube-node-7dnpq\" (UID: \"9282ff21-e3a5-4faf-b52f-cba5853d8f6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.573103 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.573045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" event={"ID":"dcb28d9929b3a5ac38ae3cfd207b04c4","Type":"ContainerStarted","Data":"7ee882c778d3dd9ac793a525370d5b8af004aa13c22fafad9054261f937861f5"} Jul 07 17:36:40.576136 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.576102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" event={"ID":"35162229216d2b61dec8255ff3fc3c97","Type":"ContainerStarted","Data":"e9637826d3ed45232adabd2176422511288c6800564e485f3d021427c2b5a8c3"} Jul 07 17:36:40.585952 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.585920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-dbus\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.585964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.585991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-system-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece089c7-eee1-4848-8f25-398f7fd71344-agent-certs\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-k8s-cni-cncf-io\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-lib-modules\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.586108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-tuned\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-os-release\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-os-release\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-bin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-kubernetes\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f10413d-de1c-49b3-abde-673ab0ff4ad6-host-slash\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-netns\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-hosts-file\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcbw\" (UniqueName: \"kubernetes.io/projected/808da2c9-ea61-4b90-815f-4aa81b55cb44-kube-api-access-wrcbw\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.586417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-cnibin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-hostroot\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-kubelet-config\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-conf\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-cnibin\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-cni-binary-copy\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-kubernetes\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-socket-dir-parent\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-socket-dir-parent\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f10413d-de1c-49b3-abde-673ab0ff4ad6-host-slash\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-netns\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.587007 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.586984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-hosts-file\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-os-release\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-bin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-os-release\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-lib-modules\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-cnibin\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587524 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-hostroot\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-k8s-cni-cncf-io\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-conf\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-cnibin\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587629 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-system-cni-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-dbus\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a785ab-fa26-4afc-ad92-6201274a38e5-kubelet-config\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:40.588422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.587960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysconfig\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysconfig\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-cni-binary-copy\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-run\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588228 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-run\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-system-cni-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5676bc7b-8173-4401-ac13-0fb155cdba80-system-cni-dir\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n26bp\" (UniqueName: \"kubernetes.io/projected/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kube-api-access-n26bp\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-sysctl-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-conf-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-conf-dir\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-tmp\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-multus\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.589264 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-cni-multus\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-multus-certs\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588541 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.588571 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-sys\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.588685 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:41.088658752 +0000 UTC m=+3.095891298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrk5d\" (UniqueName: \"kubernetes.io/projected/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-kube-api-access-nrk5d\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4rt\" (UniqueName: \"kubernetes.io/projected/5676bc7b-8173-4401-ac13-0fb155cdba80-kube-api-access-vs4rt\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-device-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-run-multus-certs\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-modprobe-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-sys\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588882 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-device-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.588922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8jfs\" (UniqueName: \"kubernetes.io/projected/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-kube-api-access-h8jfs\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-modprobe-d\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.590042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-daemon-config\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h77z\" (UniqueName: \"kubernetes.io/projected/ffe63a58-8548-4c53-b125-2dc2026a881c-kube-api-access-8h77z\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece089c7-eee1-4848-8f25-398f7fd71344-konnectivity-ca\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5676bc7b-8173-4401-ac13-0fb155cdba80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f10413d-de1c-49b3-abde-673ab0ff4ad6-iptables-alerter-script\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqb2\" (UniqueName: \"kubernetes.io/projected/2f10413d-de1c-49b3-abde-673ab0ff4ad6-kube-api-access-7vqb2\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-etc-kubernetes\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-systemd\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-var-lib-kubelet\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589887 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-host\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-tmp-dir\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.589936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-kubelet\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-host-var-lib-kubelet\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe63a58-8548-4c53-b125-2dc2026a881c-multus-daemon-config\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.590878 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece089c7-eee1-4848-8f25-398f7fd71344-konnectivity-ca\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-var-lib-kubelet\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.590288 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-host\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe63a58-8548-4c53-b125-2dc2026a881c-etc-kubernetes\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.590369 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:41.090351697 +0000 UTC m=+3.097584224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-systemd\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.590583 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-tmp-dir\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.591704 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.591046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f10413d-de1c-49b3-abde-673ab0ff4ad6-iptables-alerter-script\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.592805 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.592779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece089c7-eee1-4848-8f25-398f7fd71344-agent-certs\") pod \"konnectivity-agent-qsmhg\" (UID: \"ece089c7-eee1-4848-8f25-398f7fd71344\") " pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.593506 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.593485 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:40.593741 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.593512 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:40.593741 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.593725 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:40.593901 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:40.593813 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:41.093797258 +0000 UTC m=+3.101029804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:40.593964 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.593899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-tmp\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.594425 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.594382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-etc-tuned\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.598401 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.598377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcbw\" (UniqueName: \"kubernetes.io/projected/808da2c9-ea61-4b90-815f-4aa81b55cb44-kube-api-access-wrcbw\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:40.603171 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.603145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h77z\" (UniqueName: \"kubernetes.io/projected/ffe63a58-8548-4c53-b125-2dc2026a881c-kube-api-access-8h77z\") pod \"multus-2csct\" (UID: \"ffe63a58-8548-4c53-b125-2dc2026a881c\") " pod="openshift-multus/multus-2csct" Jul 07 17:36:40.603553 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.603532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8jfs\" (UniqueName: \"kubernetes.io/projected/8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42-kube-api-access-h8jfs\") pod \"tuned-mfd5s\" (UID: \"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42\") " pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.603646 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.603564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4rt\" (UniqueName: \"kubernetes.io/projected/5676bc7b-8173-4401-ac13-0fb155cdba80-kube-api-access-vs4rt\") pod \"multus-additional-cni-plugins-fl42s\" (UID: \"5676bc7b-8173-4401-ac13-0fb155cdba80\") " pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.604170 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.604130 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n26bp\" (UniqueName: \"kubernetes.io/projected/9c22ef53-a132-4c55-a825-b3a47a3a4fdd-kube-api-access-n26bp\") pod \"aws-ebs-csi-driver-node-qp9xt\" (UID: \"9c22ef53-a132-4c55-a825-b3a47a3a4fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.605824 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.605788 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrk5d\" (UniqueName: \"kubernetes.io/projected/4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2-kube-api-access-nrk5d\") pod \"node-resolver-6bnfw\" (UID: \"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2\") " pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.606352 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.606276 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqb2\" (UniqueName: \"kubernetes.io/projected/2f10413d-de1c-49b3-abde-673ab0ff4ad6-kube-api-access-7vqb2\") pod \"iptables-alerter-f976l\" (UID: \"2f10413d-de1c-49b3-abde-673ab0ff4ad6\") " pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.679419 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.679387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:36:40.687678 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.687651 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9282ff21_e3a5_4faf_b52f_cba5853d8f6a.slice/crio-b0e4a4587c20f4243bf724c8eff776490f92cf9b91e5bc6bbd3a6e2035734efe WatchSource:0}: Error finding container b0e4a4587c20f4243bf724c8eff776490f92cf9b91e5bc6bbd3a6e2035734efe: Status 404 returned error can't find the container with id b0e4a4587c20f4243bf724c8eff776490f92cf9b91e5bc6bbd3a6e2035734efe Jul 07 17:36:40.694415 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.694396 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgpnx" Jul 07 17:36:40.703767 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.703742 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ead001_dfc6_4b72_bee7_afb093970c49.slice/crio-9a427bf423e3b83f94afc01bfb3c7e092323793268cf225e3afa840dd4872817 WatchSource:0}: Error finding container 9a427bf423e3b83f94afc01bfb3c7e092323793268cf225e3afa840dd4872817: Status 404 returned error can't find the container with id 9a427bf423e3b83f94afc01bfb3c7e092323793268cf225e3afa840dd4872817 Jul 07 17:36:40.704935 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.704911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" Jul 07 17:36:40.711638 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.711620 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bnfw" Jul 07 17:36:40.714110 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.714061 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb61bd4_11bc_4cb3_9a1e_bb1ee0f03a42.slice/crio-888a3e70ead93622131cc4cf8c04f4b7dc20d5d23c85e37a27b6a70518424520 WatchSource:0}: Error finding container 888a3e70ead93622131cc4cf8c04f4b7dc20d5d23c85e37a27b6a70518424520: Status 404 returned error can't find the container with id 888a3e70ead93622131cc4cf8c04f4b7dc20d5d23c85e37a27b6a70518424520 Jul 07 17:36:40.720156 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.720135 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4334f7a7_76bb_4b0f_a4ba_ec1f0ed30bd2.slice/crio-16b28411f9b6e2951a7718162fea36b8c9c5d5e388615b500d1fc4db55d4d7e7 WatchSource:0}: Error finding container 16b28411f9b6e2951a7718162fea36b8c9c5d5e388615b500d1fc4db55d4d7e7: Status 404 returned error can't find the container with id 16b28411f9b6e2951a7718162fea36b8c9c5d5e388615b500d1fc4db55d4d7e7 Jul 07 17:36:40.721045 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.721027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f976l" Jul 07 17:36:40.729644 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.729613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:40.731449 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.731428 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f10413d_de1c_49b3_abde_673ab0ff4ad6.slice/crio-5c8c0991379c2814010cb1599fff9685d896c6eb53c387f690e81df94f90f694 WatchSource:0}: Error finding container 5c8c0991379c2814010cb1599fff9685d896c6eb53c387f690e81df94f90f694: Status 404 returned error can't find the container with id 5c8c0991379c2814010cb1599fff9685d896c6eb53c387f690e81df94f90f694 Jul 07 17:36:40.737834 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.737811 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl42s" Jul 07 17:36:40.740193 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.740165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece089c7_eee1_4848_8f25_398f7fd71344.slice/crio-28faf2c96a5c154802608187c1ac2bab119f3bc80cfa362c60948e8415832994 WatchSource:0}: Error finding container 28faf2c96a5c154802608187c1ac2bab119f3bc80cfa362c60948e8415832994: Status 404 returned error can't find the container with id 28faf2c96a5c154802608187c1ac2bab119f3bc80cfa362c60948e8415832994 Jul 07 17:36:40.745229 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.745092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" Jul 07 17:36:40.748879 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.748855 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5676bc7b_8173_4401_ac13_0fb155cdba80.slice/crio-fa5966adae8476c5e743297a601b95abe6c4b7c28eb6fc27835f23e5e76e7878 WatchSource:0}: Error finding container fa5966adae8476c5e743297a601b95abe6c4b7c28eb6fc27835f23e5e76e7878: Status 404 returned error can't find the container with id fa5966adae8476c5e743297a601b95abe6c4b7c28eb6fc27835f23e5e76e7878 Jul 07 17:36:40.749913 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:40.749897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2csct" Jul 07 17:36:40.758889 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.758863 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c22ef53_a132_4c55_a825_b3a47a3a4fdd.slice/crio-780a8009a2ef9bdd663b1b8c89d5569c5c07ee5a49be8cca78bca05757070b7f WatchSource:0}: Error finding container 780a8009a2ef9bdd663b1b8c89d5569c5c07ee5a49be8cca78bca05757070b7f: Status 404 returned error can't find the container with id 780a8009a2ef9bdd663b1b8c89d5569c5c07ee5a49be8cca78bca05757070b7f Jul 07 17:36:40.762375 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:36:40.762283 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe63a58_8548_4c53_b125_2dc2026a881c.slice/crio-ba6caf07d78ec6b632d9106ab141bfee67d974cb5445ff235e1e29578f84395e WatchSource:0}: Error finding container ba6caf07d78ec6b632d9106ab141bfee67d974cb5445ff235e1e29578f84395e: Status 404 returned error can't find the container with id ba6caf07d78ec6b632d9106ab141bfee67d974cb5445ff235e1e29578f84395e Jul 07 17:36:41.093981 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.093850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:41.093981 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.093928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:41.093981 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.093961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:41.094256 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094083 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:41.094256 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094145 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.094126675 +0000 UTC m=+4.101359244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:41.094556 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094519 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:41.094556 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094555 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:41.094731 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094570 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:41.094731 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094525 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:41.094731 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094624 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.094606559 +0000 UTC m=+4.101839089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:41.094731 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.094696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.094678219 +0000 UTC m=+4.101910751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:41.410014 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.409906 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:40 +0000 UTC" deadline="2027-12-11 10:24:10.728860862 +0000 UTC" Jul 07 17:36:41.410014 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.409965 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12520h47m29.318900096s" Jul 07 17:36:41.565741 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.565688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:41.565927 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:41.565836 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:41.579125 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.579085 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerStarted","Data":"fa5966adae8476c5e743297a601b95abe6c4b7c28eb6fc27835f23e5e76e7878"} Jul 07 17:36:41.580341 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.580311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qsmhg" event={"ID":"ece089c7-eee1-4848-8f25-398f7fd71344","Type":"ContainerStarted","Data":"28faf2c96a5c154802608187c1ac2bab119f3bc80cfa362c60948e8415832994"} Jul 07 17:36:41.582060 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.582029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f976l" event={"ID":"2f10413d-de1c-49b3-abde-673ab0ff4ad6","Type":"ContainerStarted","Data":"5c8c0991379c2814010cb1599fff9685d896c6eb53c387f690e81df94f90f694"} Jul 07 17:36:41.584252 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.584222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bnfw" event={"ID":"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2","Type":"ContainerStarted","Data":"16b28411f9b6e2951a7718162fea36b8c9c5d5e388615b500d1fc4db55d4d7e7"} Jul 07 17:36:41.585320 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.585294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" event={"ID":"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42","Type":"ContainerStarted","Data":"888a3e70ead93622131cc4cf8c04f4b7dc20d5d23c85e37a27b6a70518424520"} Jul 07 17:36:41.586614 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.586594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2csct" event={"ID":"ffe63a58-8548-4c53-b125-2dc2026a881c","Type":"ContainerStarted","Data":"ba6caf07d78ec6b632d9106ab141bfee67d974cb5445ff235e1e29578f84395e"} Jul 07 17:36:41.587747 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.587726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgpnx" event={"ID":"82ead001-dfc6-4b72-bee7-afb093970c49","Type":"ContainerStarted","Data":"9a427bf423e3b83f94afc01bfb3c7e092323793268cf225e3afa840dd4872817"} Jul 07 17:36:41.588841 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.588808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"b0e4a4587c20f4243bf724c8eff776490f92cf9b91e5bc6bbd3a6e2035734efe"} Jul 07 17:36:41.590219 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:41.590199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" event={"ID":"9c22ef53-a132-4c55-a825-b3a47a3a4fdd","Type":"ContainerStarted","Data":"780a8009a2ef9bdd663b1b8c89d5569c5c07ee5a49be8cca78bca05757070b7f"} Jul 07 17:36:42.102465 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.102415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:42.102650 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.102487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:42.102650 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.102537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:42.102762 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102723 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:42.102812 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102788 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.102769533 +0000 UTC m=+6.110002064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:42.102897 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102882 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:42.102948 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102903 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:42.102948 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102915 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:42.103050 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.102963 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.102942256 +0000 UTC m=+6.110174782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:42.103050 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.103023 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:42.103150 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.103057 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.103045396 +0000 UTC m=+6.110277929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:42.411234 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.411119 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:40 +0000 UTC" deadline="2028-02-19 17:25:05.465008606 +0000 UTC" Jul 07 17:36:42.411234 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.411160 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14207h48m23.053853421s" Jul 07 17:36:42.568889 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.568851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:42.569070 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.568975 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:42.569392 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.569372 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:42.569573 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:42.569482 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:42.604308 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:42.604266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" event={"ID":"dcb28d9929b3a5ac38ae3cfd207b04c4","Type":"ContainerStarted","Data":"cd510c0b201998c9c2145a863d505b52048a4b895833acd281060db006079ffc"} Jul 07 17:36:43.566789 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:43.566264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:43.566789 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:43.566407 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:43.635784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:43.635707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" event={"ID":"35162229216d2b61dec8255ff3fc3c97","Type":"ContainerStarted","Data":"e95c8fec7939e80614013734558f6b1f551b9839ad804dc5f0ddcf7ab6dd8aba"} Jul 07 17:36:43.660473 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:43.656000 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.ec2.internal" podStartSLOduration=4.655976341 podStartE2EDuration="4.655976341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:42.620021272 +0000 UTC m=+4.627253821" watchObservedRunningTime="2026-07-07 17:36:43.655976341 +0000 UTC m=+5.663208891" Jul 07 17:36:44.121421 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:44.121379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:44.121633 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:44.121430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:44.121633 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:44.121487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:44.121746 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.121634 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:44.121746 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.121693 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:48.121676032 +0000 UTC m=+10.128908575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:44.122122 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122103 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:44.122184 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122129 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:44.122184 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122142 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:44.122280 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122190 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:48.12217511 +0000 UTC m=+10.129407642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:44.122280 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122247 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:44.122386 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.122289 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:48.122268117 +0000 UTC m=+10.129500649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:44.566481 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:44.565922 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:44.566481 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.566052 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:44.567055 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:44.566890 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:44.567055 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:44.567020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:45.565977 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:45.565891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:45.566140 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:45.566035 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:45.642591 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:45.642561 2567 generic.go:356] "Generic (PLEG): container finished" podID="35162229216d2b61dec8255ff3fc3c97" containerID="e95c8fec7939e80614013734558f6b1f551b9839ad804dc5f0ddcf7ab6dd8aba" exitCode=0 Jul 07 17:36:45.643027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:45.642606 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" event={"ID":"35162229216d2b61dec8255ff3fc3c97","Type":"ContainerDied","Data":"e95c8fec7939e80614013734558f6b1f551b9839ad804dc5f0ddcf7ab6dd8aba"} Jul 07 17:36:46.566082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:46.566003 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:46.566268 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:46.566133 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:46.566363 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:46.566318 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:46.566492 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:46.566422 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:47.566373 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:47.566338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:47.566843 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:47.566449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:48.156414 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:48.156367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:48.156593 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:48.156426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:48.156593 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:48.156485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:48.156593 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156582 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156596 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156610 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156625 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156655 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:56.156641355 +0000 UTC m=+18.163873882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156596 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156669 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:56.156662882 +0000 UTC m=+18.163895407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:48.156742 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.156687 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:56.156675455 +0000 UTC m=+18.163907985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:48.567718 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:48.567635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:48.568119 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:48.567726 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:48.568119 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.567751 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:48.568119 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:48.567830 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:49.566400 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:49.566366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:49.566591 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:49.566539 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:50.566706 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:50.566641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:50.567190 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:50.566805 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:50.567190 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:50.566648 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:50.567190 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:50.566973 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:51.566223 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.566019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:51.566399 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:51.566332 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:51.656947 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.656903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" event={"ID":"35162229216d2b61dec8255ff3fc3c97","Type":"ContainerStarted","Data":"fc24176cfafe013f12416d35724ed47982b49e7ed56a0753a5eb1b6940c69664"} Jul 07 17:36:51.658956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.658921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" event={"ID":"9c22ef53-a132-4c55-a825-b3a47a3a4fdd","Type":"ContainerStarted","Data":"00705e5047baa17ba88ee270915a66c83b8290df4566f159db8ec41042ec8f18"} Jul 07 17:36:51.660495 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.660466 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="81292bcecf8beb003e5294feac12b5a67b5ec65f1f2b3b93668f7d1d30310824" exitCode=0 Jul 07 17:36:51.660612 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.660488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"81292bcecf8beb003e5294feac12b5a67b5ec65f1f2b3b93668f7d1d30310824"} Jul 07 17:36:51.662136 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.662114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qsmhg" event={"ID":"ece089c7-eee1-4848-8f25-398f7fd71344","Type":"ContainerStarted","Data":"927c18d1966e171b445f94c1c4616d5c60ce73787bdfc2d0191e4696308b03a6"} Jul 07 17:36:51.663818 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.663795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bnfw" event={"ID":"4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2","Type":"ContainerStarted","Data":"2d2a2a6a0dee1e7cc71a9ef83be5b5ceb7711da237858859a04823aefd0533db"} Jul 07 17:36:51.667846 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.667818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" event={"ID":"8cb61bd4-11bc-4cb3-9a1e-bb1ee0f03a42","Type":"ContainerStarted","Data":"cad8203bc0314d5b686f4f186de4d51d7d2619f082f25162eed0c6daae95e326"} Jul 07 17:36:51.669103 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.669084 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgpnx" event={"ID":"82ead001-dfc6-4b72-bee7-afb093970c49","Type":"ContainerStarted","Data":"b668c8dd1a52b83903582fd6fe4781f21763d5bccb504dd6eda2614ce89300bf"} Jul 07 17:36:51.672139 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.672106 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.ec2.internal" podStartSLOduration=12.672095356 podStartE2EDuration="12.672095356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:51.671714953 +0000 UTC m=+13.678947502" watchObservedRunningTime="2026-07-07 17:36:51.672095356 +0000 UTC m=+13.679327904" Jul 07 17:36:51.719988 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.719881 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mfd5s" podStartSLOduration=3.67110392 podStartE2EDuration="13.719866152s" totalImagesPullingTime="10.048762232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:51.706479314 +0000 UTC m=+13.713711877" watchObservedRunningTime="2026-07-07 17:36:51.719866152 +0000 UTC m=+13.727098700" Jul 07 17:36:51.720128 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.719985 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6bnfw" podStartSLOduration=3.696372159 podStartE2EDuration="13.719979252s" totalImagesPullingTime="10.023607093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:51.719856027 +0000 UTC m=+13.727088577" watchObservedRunningTime="2026-07-07 17:36:51.719979252 +0000 UTC m=+13.727211799" Jul 07 17:36:51.737959 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.737911 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qsmhg" podStartSLOduration=3.733667181 podStartE2EDuration="13.73789778s" totalImagesPullingTime="10.004230599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:51.737318682 +0000 UTC m=+13.744551231" watchObservedRunningTime="2026-07-07 17:36:51.73789778 +0000 UTC m=+13.745130327" Jul 07 17:36:51.759624 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:51.759571 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fgpnx" podStartSLOduration=3.718390603 podStartE2EDuration="13.759554873s" totalImagesPullingTime="10.04116427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:51.759083153 +0000 UTC m=+13.766315703" watchObservedRunningTime="2026-07-07 17:36:51.759554873 +0000 UTC m=+13.766787425" Jul 07 17:36:52.566495 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:52.566450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:52.566674 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:52.566605 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:52.567086 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:52.567060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:52.567218 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:52.567164 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:52.673289 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:52.673239 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f976l" event={"ID":"2f10413d-de1c-49b3-abde-673ab0ff4ad6","Type":"ContainerStarted","Data":"569b10975392f62a5e37bf8bd6adcfabb49d5ff04f1c01e65d301e550587cebc"} Jul 07 17:36:52.690439 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:52.690383 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f976l" podStartSLOduration=4.676144191 podStartE2EDuration="14.690364158s" totalImagesPullingTime="10.014219967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:52.690025299 +0000 UTC m=+14.697257872" watchObservedRunningTime="2026-07-07 17:36:52.690364158 +0000 UTC m=+14.697596708" Jul 07 17:36:53.052507 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.052274 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 17:36:53.437225 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.436741 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:36:53.052506632Z","UUID":"756ba7ef-5b01-4b8a-bee6-0163702600f0","Handler":null,"Name":"","Endpoint":""} Jul 07 17:36:53.439091 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.438682 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 17:36:53.439091 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.438726 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 17:36:53.566649 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.566615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:53.566808 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:53.566752 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:53.652476 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.652427 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:53.653253 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.653231 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:53.679096 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.679061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" event={"ID":"9c22ef53-a132-4c55-a825-b3a47a3a4fdd","Type":"ContainerStarted","Data":"9dab5a37c19eea2f9a5ff278b31519175d6c87af98027083c072cb7c1b389d73"} Jul 07 17:36:53.679666 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.679448 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:53.679801 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:53.679778 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qsmhg" Jul 07 17:36:54.566149 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:54.566114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:54.566325 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:54.566114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:54.566325 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:54.566245 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:54.566432 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:54.566342 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:55.566536 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:55.566304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:55.566536 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:55.566447 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:56.221325 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:56.221281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:56.221325 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:56.221325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:56.221419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221437 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221506 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:12.22148816 +0000 UTC m=+34.228720693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221540 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221558 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:56.221574 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221576 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:56.221831 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221589 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:56.221831 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:12.221577418 +0000 UTC m=+34.228809944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:56.221831 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.221645 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:12.22163079 +0000 UTC m=+34.228863316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:56.566082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:56.565998 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:56.566082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:56.566024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:56.566277 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.566148 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:56.566332 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:56.566267 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:57.566015 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:57.565980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:57.566554 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:57.566155 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:36:58.569093 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:58.569061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:36:58.569543 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:58.569169 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:36:58.569543 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:58.569217 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:36:58.569543 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:58.569299 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:36:59.566407 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:36:59.566375 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:36:59.566576 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:36:59.566505 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:00.569406 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:00.569378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:00.570048 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:00.569378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:00.570048 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:00.569530 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:00.570048 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:00.569557 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:01.565873 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:01.565840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:01.566118 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:01.565972 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:02.566426 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:02.566385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:02.566924 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:02.566534 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:02.566924 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:02.566588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:02.566924 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:02.566687 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:03.566020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:03.565992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:03.566201 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:03.566113 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:04.566580 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.566333 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:04.567226 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.566399 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:04.567226 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:04.566629 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:04.567226 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:04.566696 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:04.706623 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.706592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" event={"ID":"9c22ef53-a132-4c55-a825-b3a47a3a4fdd","Type":"ContainerStarted","Data":"55583e79edac4d853ec2ad6becb7bf0d9d305edf5f7a72ebe46e3805cd70ccf3"} Jul 07 17:37:04.708287 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.708265 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="9f3611573c3aa71ee5a8663df6dfc76257ef9edd2bf4171c704365e07f542ae4" exitCode=0 Jul 07 17:37:04.708392 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.708312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"9f3611573c3aa71ee5a8663df6dfc76257ef9edd2bf4171c704365e07f542ae4"} Jul 07 17:37:04.713044 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.713008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2csct" event={"ID":"ffe63a58-8548-4c53-b125-2dc2026a881c","Type":"ContainerStarted","Data":"70a908fe5aa9ac80b0b751d4dbc10ca64e362bb4731c629c48ddf1a0d300c4e3"} Jul 07 17:37:04.715791 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"930a8db6336ae67201d713a9994192b7db4b2d868a3fcfca5b41d591db28b7ce"} Jul 07 17:37:04.715894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"5101f185dcecc8f9407542d9e53c3b3bf638f14e7a7eceeac04f6bc0f1ce5915"} Jul 07 17:37:04.715894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"c0abd7416a9e8f53977fb267fdde37e4b4cac5eeb02cc177eac7b33c114089ee"} Jul 07 17:37:04.715894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"cf6f53a9805f7c369f75ab12be3022a6fe307a56dd555b45148025b7a884b69c"} Jul 07 17:37:04.716003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715914 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"2dd45f9a1308b342665582920f09c1e3d0afea871c5cef5c1a04700f184c7a5a"} Jul 07 17:37:04.716003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.715947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"c23f62952e3719365b3360e603b8734eee670ff0a723508816b554dd272a8225"} Jul 07 17:37:04.725607 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.725566 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qp9xt" podStartSLOduration=4.315792152 podStartE2EDuration="26.725554431s" totalImagesPullingTime="22.409762279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.72525878 +0000 UTC m=+26.732491329" watchObservedRunningTime="2026-07-07 17:37:04.725554431 +0000 UTC m=+26.732786979" Jul 07 17:37:04.766598 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:04.766560 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2csct" podStartSLOduration=3.797968328 podStartE2EDuration="26.766547878s" totalImagesPullingTime="22.96857955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.765971172 +0000 UTC m=+26.773203722" watchObservedRunningTime="2026-07-07 17:37:04.766547878 +0000 UTC m=+26.773780425" Jul 07 17:37:05.565645 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:05.565612 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:05.565924 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:05.565727 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:06.566042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:06.565831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:06.566706 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:06.565855 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:06.566706 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:06.566148 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:06.566706 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:06.566178 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:06.723678 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:06.723601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"88795203f6b1d9315d529e00df2f07a035fd2f18d02efb57228f3d3103baa386"} Jul 07 17:37:06.725501 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:06.725474 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="f06c177463f40db0dc3eef2f11d737648d9277df302553915744bf3d34ebcf5c" exitCode=0 Jul 07 17:37:06.725637 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:06.725515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"f06c177463f40db0dc3eef2f11d737648d9277df302553915744bf3d34ebcf5c"} Jul 07 17:37:07.565789 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:07.565747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:07.565974 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:07.565898 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:08.567607 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.567576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:08.567907 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:08.567692 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:08.567907 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.567734 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:08.567907 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:08.567825 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:08.732387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.732309 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="2cbaacb59260247888c64dad5b37a919d81efaa96def35476bc3041dc0409c0d" exitCode=0 Jul 07 17:37:08.732387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.732375 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"2cbaacb59260247888c64dad5b37a919d81efaa96def35476bc3041dc0409c0d"} Jul 07 17:37:08.736119 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.736098 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" event={"ID":"9282ff21-e3a5-4faf-b52f-cba5853d8f6a","Type":"ContainerStarted","Data":"c23cf62d6732be9944fa082ce68ffe64a8c1f97a5619da0f51ee0dab6fa89166"} Jul 07 17:37:08.736371 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.736355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:08.736424 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.736412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:08.752411 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.752389 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:08.795894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:08.794743 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" podStartSLOduration=7.789783872 podStartE2EDuration="30.794723083s" totalImagesPullingTime="23.004939211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:08.793909193 +0000 UTC m=+30.801141762" watchObservedRunningTime="2026-07-07 17:37:08.794723083 +0000 UTC m=+30.801955629" Jul 07 17:37:09.566642 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:09.566614 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:09.566831 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:09.566734 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:09.740579 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:09.740551 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:09.760921 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:09.760888 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:10.566206 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.566053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:10.566333 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.566108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:10.566333 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:10.566311 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:10.566438 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:10.566345 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:10.710396 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.710358 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6npr"] Jul 07 17:37:10.711229 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.711076 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6szj"] Jul 07 17:37:10.712094 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.711794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hslb"] Jul 07 17:37:10.712094 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.711894 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:10.712094 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:10.712007 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:10.742267 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.742189 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:10.742698 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:10.742201 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:10.742698 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:10.742304 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:10.742698 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:10.742412 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:12.249569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.249526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.249599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.249622 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249677 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249706 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249741 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret podName:41a785ab-fa26-4afc-ad92-6201274a38e5 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:44.249726305 +0000 UTC m=+66.256958836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret") pod "global-pull-secret-syncer-x6npr" (UID: "41a785ab-fa26-4afc-ad92-6201274a38e5") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249742 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249755 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:44.249749078 +0000 UTC m=+66.256981607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249762 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249771 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pvw5l for pod openshift-network-diagnostics/network-check-target-l6szj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:37:12.250028 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.249812 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l podName:4cda405d-75ba-4e1e-83a7-3e3fca819f64 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:44.249798341 +0000 UTC m=+66.257030867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvw5l" (UniqueName: "kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l") pod "network-check-target-l6szj" (UID: "4cda405d-75ba-4e1e-83a7-3e3fca819f64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:37:12.566166 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.566139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:12.566341 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.566139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:12.566341 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:12.566141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:12.566341 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.566294 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:12.566533 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.566384 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:12.566533 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:12.566451 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:14.565740 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:14.565711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:14.566279 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:14.565711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:14.566279 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:14.565823 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:14.566279 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:14.565938 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:14.566279 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:14.565711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:14.566279 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:14.566008 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:14.755422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:14.755331 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="5eb43af32f2f9e9ae0bf798c4772bffc04d9067757ca4c1d902adf57a9fa1d3a" exitCode=0 Jul 07 17:37:14.755422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:14.755376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"5eb43af32f2f9e9ae0bf798c4772bffc04d9067757ca4c1d902adf57a9fa1d3a"} Jul 07 17:37:15.760255 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:15.760223 2567 generic.go:356] "Generic (PLEG): container finished" podID="5676bc7b-8173-4401-ac13-0fb155cdba80" containerID="e14286f8e36d6a9cb5f8477ca91813f560b760230ba2e9d13ad27107e35edd55" exitCode=0 Jul 07 17:37:15.760646 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:15.760277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerDied","Data":"e14286f8e36d6a9cb5f8477ca91813f560b760230ba2e9d13ad27107e35edd55"} Jul 07 17:37:16.565886 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:16.565859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:16.566051 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:16.565863 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:16.566051 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:16.565964 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6szj" podUID="4cda405d-75ba-4e1e-83a7-3e3fca819f64" Jul 07 17:37:16.566123 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:16.566073 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hslb" podUID="808da2c9-ea61-4b90-815f-4aa81b55cb44" Jul 07 17:37:16.566156 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:16.566118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:16.566263 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:16.566240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6npr" podUID="41a785ab-fa26-4afc-ad92-6201274a38e5" Jul 07 17:37:16.765692 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:16.765653 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl42s" event={"ID":"5676bc7b-8173-4401-ac13-0fb155cdba80","Type":"ContainerStarted","Data":"2fbe50822c5a32cd6d40b52ba79e91434abfbd71a70f096a954bea8a69248a2a"} Jul 07 17:37:16.789053 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:16.789011 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fl42s" podStartSLOduration=8.192873538 podStartE2EDuration="38.788995407s" totalImagesPullingTime="30.596121869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:16.787243974 +0000 UTC m=+38.794476521" watchObservedRunningTime="2026-07-07 17:37:16.788995407 +0000 UTC m=+38.796227955" Jul 07 17:37:17.260713 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.260532 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-236.ec2.internal" event="NodeReady" Jul 07 17:37:17.260848 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.260812 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 17:37:17.330566 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.330535 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p4l64"] Jul 07 17:37:17.352678 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.352644 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6kf7w"] Jul 07 17:37:17.352847 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.352772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.355637 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.355616 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 17:37:17.355747 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.355681 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\"" Jul 07 17:37:17.355937 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.355924 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 17:37:17.376821 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.376758 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p4l64"] Jul 07 17:37:17.376821 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.376794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6kf7w"] Jul 07 17:37:17.376968 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.376869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.379900 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.379877 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 17:37:17.380003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.379942 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 17:37:17.380003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.379943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 17:37:17.380003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.379993 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-trtbr\"" Jul 07 17:37:17.488344 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/222eeaeb-5b75-43cc-b6e7-9af69be1c957-config-volume\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.488344 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.488569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef0e22c-86c9-4d02-a1ab-a779ee296596-cert\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.488569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222eeaeb-5b75-43cc-b6e7-9af69be1c957-tmp-dir\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.488569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvgk\" (UniqueName: \"kubernetes.io/projected/4ef0e22c-86c9-4d02-a1ab-a779ee296596-kube-api-access-7hvgk\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.488569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.488504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggpbv\" (UniqueName: \"kubernetes.io/projected/222eeaeb-5b75-43cc-b6e7-9af69be1c957-kube-api-access-ggpbv\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.589760 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef0e22c-86c9-4d02-a1ab-a779ee296596-cert\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.589760 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222eeaeb-5b75-43cc-b6e7-9af69be1c957-tmp-dir\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.589978 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvgk\" (UniqueName: \"kubernetes.io/projected/4ef0e22c-86c9-4d02-a1ab-a779ee296596-kube-api-access-7hvgk\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.589978 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589831 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggpbv\" (UniqueName: \"kubernetes.io/projected/222eeaeb-5b75-43cc-b6e7-9af69be1c957-kube-api-access-ggpbv\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.589978 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/222eeaeb-5b75-43cc-b6e7-9af69be1c957-config-volume\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.589978 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.589938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.590161 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:17.590064 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:17.590161 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:17.590134 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:18.090115573 +0000 UTC m=+40.097348106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:17.590266 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.590181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/222eeaeb-5b75-43cc-b6e7-9af69be1c957-tmp-dir\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.590444 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.590423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/222eeaeb-5b75-43cc-b6e7-9af69be1c957-config-volume\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.594016 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.594000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef0e22c-86c9-4d02-a1ab-a779ee296596-cert\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.598120 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.598093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvgk\" (UniqueName: \"kubernetes.io/projected/4ef0e22c-86c9-4d02-a1ab-a779ee296596-kube-api-access-7hvgk\") pod \"ingress-canary-6kf7w\" (UID: \"4ef0e22c-86c9-4d02-a1ab-a779ee296596\") " pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.598120 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.598116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggpbv\" (UniqueName: \"kubernetes.io/projected/222eeaeb-5b75-43cc-b6e7-9af69be1c957-kube-api-access-ggpbv\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:17.684871 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.684773 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6kf7w" Jul 07 17:37:17.883470 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:17.883426 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6kf7w"] Jul 07 17:37:17.887520 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:17.887493 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef0e22c_86c9_4d02_a1ab_a779ee296596.slice/crio-b1b466e4054c6ecff17d5c8fafea2f24d7ba38eee253daa77ec5ee623da34843 WatchSource:0}: Error finding container b1b466e4054c6ecff17d5c8fafea2f24d7ba38eee253daa77ec5ee623da34843: Status 404 returned error can't find the container with id b1b466e4054c6ecff17d5c8fafea2f24d7ba38eee253daa77ec5ee623da34843 Jul 07 17:37:18.093836 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.093804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:18.093985 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:18.093923 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:18.093985 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:18.093973 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:19.093961108 +0000 UTC m=+41.101193634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:18.567960 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.567920 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:18.568137 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.568004 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:18.568137 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.568043 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:18.570796 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.570771 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:37:18.572052 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.572024 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:37:18.572052 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.572043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:37:18.572252 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.572060 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:37:18.572252 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.572090 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\"" Jul 07 17:37:18.572404 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.572299 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\"" Jul 07 17:37:18.771422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:18.771206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6kf7w" event={"ID":"4ef0e22c-86c9-4d02-a1ab-a779ee296596","Type":"ContainerStarted","Data":"b1b466e4054c6ecff17d5c8fafea2f24d7ba38eee253daa77ec5ee623da34843"} Jul 07 17:37:19.101964 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:19.101921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:19.102366 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:19.102066 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:19.102366 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:19.102122 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:21.102104658 +0000 UTC m=+43.109337204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:20.777956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:20.777919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6kf7w" event={"ID":"4ef0e22c-86c9-4d02-a1ab-a779ee296596","Type":"ContainerStarted","Data":"918f962607ef45c5e2b12c45b6fa83c8ae8b1988e4e03335ce883abfe3053d79"} Jul 07 17:37:20.793397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:20.793341 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6kf7w" podStartSLOduration=1.220442616 podStartE2EDuration="3.7933279s" totalImagesPullingTime="2.572885284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:20.793000494 +0000 UTC m=+42.800233041" watchObservedRunningTime="2026-07-07 17:37:20.7933279 +0000 UTC m=+42.800560447" Jul 07 17:37:21.115977 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:21.115869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:21.116125 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:21.116037 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:21.116125 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:21.116102 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:25.116085938 +0000 UTC m=+47.123318465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:25.145695 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:25.145649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:25.146185 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:25.145794 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:25.146185 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:25.145893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.145877905 +0000 UTC m=+55.153110432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:29.474800 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.474767 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj"] Jul 07 17:37:29.487417 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.487393 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj"] Jul 07 17:37:29.487578 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.487501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.490175 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.490150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.491431 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.491414 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 17:37:29.491549 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.491485 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.491549 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.491526 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 17:37:29.491643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.491553 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7pc45\"" Jul 07 17:37:29.572167 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.572126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmtv\" (UniqueName: \"kubernetes.io/projected/4a35f343-d19d-4251-9f8d-097469997f47-kube-api-access-lrmtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.572360 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.572194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a35f343-d19d-4251-9f8d-097469997f47-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.572360 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.572260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a35f343-d19d-4251-9f8d-097469997f47-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.574037 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.574012 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2"] Jul 07 17:37:29.595797 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.595756 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qlqzp"] Jul 07 17:37:29.595981 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.595908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.598601 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.598573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 17:37:29.598744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.598630 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nblrl\"" Jul 07 17:37:29.598744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.598630 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.598744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.598706 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 17:37:29.598988 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.598964 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.607531 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.607509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2"] Jul 07 17:37:29.607686 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.607541 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qlqzp"] Jul 07 17:37:29.607686 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.607617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.610135 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.610114 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 17:37:29.610254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.610162 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.610254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.610227 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gp2c7\"" Jul 07 17:37:29.610355 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.610342 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.610740 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.610722 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 17:37:29.615121 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.615100 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 17:37:29.672674 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a35f343-d19d-4251-9f8d-097469997f47-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.672853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m9b8\" (UniqueName: \"kubernetes.io/projected/981d40a9-f413-4918-857b-c270bf88ee4d-kube-api-access-9m9b8\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.672853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92s5\" (UniqueName: \"kubernetes.io/projected/4b84d039-1ed8-43ca-92f8-dfc8e0381259-kube-api-access-s92s5\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.672853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a35f343-d19d-4251-9f8d-097469997f47-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.672853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-config\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.672853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b84d039-1ed8-43ca-92f8-dfc8e0381259-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.673020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/981d40a9-f413-4918-857b-c270bf88ee4d-serving-cert\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.673020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-trusted-ca\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.673020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.672961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmtv\" (UniqueName: \"kubernetes.io/projected/4a35f343-d19d-4251-9f8d-097469997f47-kube-api-access-lrmtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.673020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.673004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b84d039-1ed8-43ca-92f8-dfc8e0381259-config\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.673375 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.673356 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a35f343-d19d-4251-9f8d-097469997f47-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.676225 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.676202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a35f343-d19d-4251-9f8d-097469997f47-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.682665 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.682636 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:37:29.688195 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.688164 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmtv\" (UniqueName: \"kubernetes.io/projected/4a35f343-d19d-4251-9f8d-097469997f47-kube-api-access-lrmtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-zbmxj\" (UID: \"4a35f343-d19d-4251-9f8d-097469997f47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.703587 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.703558 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:37:29.703717 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.703654 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.706145 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.706123 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 17:37:29.706254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.706191 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hdmrj\"" Jul 07 17:37:29.706254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.706214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 17:37:29.706449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.706437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 17:37:29.711373 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.711356 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 17:37:29.773669 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m9b8\" (UniqueName: \"kubernetes.io/projected/981d40a9-f413-4918-857b-c270bf88ee4d-kube-api-access-9m9b8\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.773669 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.773865 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.773865 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.773865 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92s5\" (UniqueName: \"kubernetes.io/projected/4b84d039-1ed8-43ca-92f8-dfc8e0381259-kube-api-access-s92s5\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.773865 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54znn\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.773865 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-config\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b84d039-1ed8-43ca-92f8-dfc8e0381259-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/981d40a9-f413-4918-857b-c270bf88ee4d-serving-cert\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.773994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-trusted-ca\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b84d039-1ed8-43ca-92f8-dfc8e0381259-config\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.774115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.774650 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-config\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.774739 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b84d039-1ed8-43ca-92f8-dfc8e0381259-config\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.774836 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.774820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/981d40a9-f413-4918-857b-c270bf88ee4d-trusted-ca\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.776056 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.776038 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b84d039-1ed8-43ca-92f8-dfc8e0381259-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.776141 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.776087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/981d40a9-f413-4918-857b-c270bf88ee4d-serving-cert\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.781806 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.781777 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92s5\" (UniqueName: \"kubernetes.io/projected/4b84d039-1ed8-43ca-92f8-dfc8e0381259-kube-api-access-s92s5\") pod \"service-ca-operator-5d46d9ffd4-vfjt2\" (UID: \"4b84d039-1ed8-43ca-92f8-dfc8e0381259\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.782285 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.782267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m9b8\" (UniqueName: \"kubernetes.io/projected/981d40a9-f413-4918-857b-c270bf88ee4d-kube-api-access-9m9b8\") pod \"console-operator-68b757fb67-qlqzp\" (UID: \"981d40a9-f413-4918-857b-c270bf88ee4d\") " pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.797129 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.797105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" Jul 07 17:37:29.875413 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54znn\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875857 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875857 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.875956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.875887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.876577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.876439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.876577 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:29.876486 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:29.876577 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:29.876504 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bdc55b665-wj5gs: secret "image-registry-tls" not found Jul 07 17:37:29.876577 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:29.876571 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls podName:09fd33b2-e5f0-4e9a-a046-a63adb9faac4 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.376551903 +0000 UTC m=+52.383784439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls") pod "image-registry-bdc55b665-wj5gs" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4") : secret "image-registry-tls" not found Jul 07 17:37:29.877016 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.876994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.878348 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.878316 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.878653 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.878627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.883921 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.883901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.884516 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.884470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54znn\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:29.905126 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.905099 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" Jul 07 17:37:29.915627 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.915596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:29.954607 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:29.954576 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj"] Jul 07 17:37:29.958853 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:29.958823 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a35f343_d19d_4251_9f8d_097469997f47.slice/crio-ddbace8f2be90a7106b3ff239c8b539f9e42846101dc1ad9fb58812b2d958ac1 WatchSource:0}: Error finding container ddbace8f2be90a7106b3ff239c8b539f9e42846101dc1ad9fb58812b2d958ac1: Status 404 returned error can't find the container with id ddbace8f2be90a7106b3ff239c8b539f9e42846101dc1ad9fb58812b2d958ac1 Jul 07 17:37:30.045564 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.045520 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2"] Jul 07 17:37:30.049412 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:30.049384 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b84d039_1ed8_43ca_92f8_dfc8e0381259.slice/crio-f8eeed6c81bdae717115f87adbbad26c2f747885c2d4efa00d10edb2f5a641be WatchSource:0}: Error finding container f8eeed6c81bdae717115f87adbbad26c2f747885c2d4efa00d10edb2f5a641be: Status 404 returned error can't find the container with id f8eeed6c81bdae717115f87adbbad26c2f747885c2d4efa00d10edb2f5a641be Jul 07 17:37:30.075171 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.075147 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qlqzp"] Jul 07 17:37:30.078369 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:30.078333 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981d40a9_f413_4918_857b_c270bf88ee4d.slice/crio-26540ab0bfcb1265c6b778c964dc207c07e39568cc6f3eed04246b84e6a5ba6a WatchSource:0}: Error finding container 26540ab0bfcb1265c6b778c964dc207c07e39568cc6f3eed04246b84e6a5ba6a: Status 404 returned error can't find the container with id 26540ab0bfcb1265c6b778c964dc207c07e39568cc6f3eed04246b84e6a5ba6a Jul 07 17:37:30.379926 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.379830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:30.380091 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:30.380030 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:30.380091 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:30.380053 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bdc55b665-wj5gs: secret "image-registry-tls" not found Jul 07 17:37:30.380198 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:30.380127 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls podName:09fd33b2-e5f0-4e9a-a046-a63adb9faac4 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.380105391 +0000 UTC m=+53.387337936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls") pod "image-registry-bdc55b665-wj5gs" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4") : secret "image-registry-tls" not found Jul 07 17:37:30.803222 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.803179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" event={"ID":"4a35f343-d19d-4251-9f8d-097469997f47","Type":"ContainerStarted","Data":"ddbace8f2be90a7106b3ff239c8b539f9e42846101dc1ad9fb58812b2d958ac1"} Jul 07 17:37:30.804625 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.804590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" event={"ID":"981d40a9-f413-4918-857b-c270bf88ee4d","Type":"ContainerStarted","Data":"26540ab0bfcb1265c6b778c964dc207c07e39568cc6f3eed04246b84e6a5ba6a"} Jul 07 17:37:30.805835 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:30.805808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" event={"ID":"4b84d039-1ed8-43ca-92f8-dfc8e0381259","Type":"ContainerStarted","Data":"f8eeed6c81bdae717115f87adbbad26c2f747885c2d4efa00d10edb2f5a641be"} Jul 07 17:37:31.389333 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:31.389295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:31.389560 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:31.389536 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:31.389560 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:31.389558 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bdc55b665-wj5gs: secret "image-registry-tls" not found Jul 07 17:37:31.389688 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:31.389628 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls podName:09fd33b2-e5f0-4e9a-a046-a63adb9faac4 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.389609283 +0000 UTC m=+55.396841811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls") pod "image-registry-bdc55b665-wj5gs" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4") : secret "image-registry-tls" not found Jul 07 17:37:33.203929 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.203881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:33.204492 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:33.204071 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:33.204492 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:33.204150 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls podName:222eeaeb-5b75-43cc-b6e7-9af69be1c957 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.204127176 +0000 UTC m=+71.211359707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls") pod "dns-default-p4l64" (UID: "222eeaeb-5b75-43cc-b6e7-9af69be1c957") : secret "dns-default-metrics-tls" not found Jul 07 17:37:33.405712 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.405674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:33.405867 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:33.405822 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:33.405867 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:33.405840 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bdc55b665-wj5gs: secret "image-registry-tls" not found Jul 07 17:37:33.405958 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:33.405894 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls podName:09fd33b2-e5f0-4e9a-a046-a63adb9faac4 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.405880046 +0000 UTC m=+59.413112572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls") pod "image-registry-bdc55b665-wj5gs" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4") : secret "image-registry-tls" not found Jul 07 17:37:33.815676 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.815632 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" event={"ID":"4b84d039-1ed8-43ca-92f8-dfc8e0381259","Type":"ContainerStarted","Data":"8a38ee52d1e75780c2dfede18c8b50d61078af595df09fe9211e32041a8bc68d"} Jul 07 17:37:33.817164 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.817140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" event={"ID":"4a35f343-d19d-4251-9f8d-097469997f47","Type":"ContainerStarted","Data":"0d209d9f5a8753191280c776ef81aa1cb76b90275174039a8abbe436327944fc"} Jul 07 17:37:33.818741 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.818721 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/0.log" Jul 07 17:37:33.818817 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.818762 2567 generic.go:356] "Generic (PLEG): container finished" podID="981d40a9-f413-4918-857b-c270bf88ee4d" containerID="0d2bb573fac636cd2d47a33e6ec4fe0a929d38fb01e3a9bc8138eb07ac55f82e" exitCode=255 Jul 07 17:37:33.818817 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.818788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" event={"ID":"981d40a9-f413-4918-857b-c270bf88ee4d","Type":"ContainerDied","Data":"0d2bb573fac636cd2d47a33e6ec4fe0a929d38fb01e3a9bc8138eb07ac55f82e"} Jul 07 17:37:33.818983 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.818970 2567 scope.go:117] "RemoveContainer" containerID="0d2bb573fac636cd2d47a33e6ec4fe0a929d38fb01e3a9bc8138eb07ac55f82e" Jul 07 17:37:33.833267 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.833218 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" podStartSLOduration=1.444106897 podStartE2EDuration="4.833199865s" totalImagesPullingTime="3.389092968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:33.832661074 +0000 UTC m=+55.839893623" watchObservedRunningTime="2026-07-07 17:37:33.833199865 +0000 UTC m=+55.840432396" Jul 07 17:37:33.868021 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:33.867968 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" podStartSLOduration=1.39522303 podStartE2EDuration="4.867952819s" totalImagesPullingTime="3.472729789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:33.867478119 +0000 UTC m=+55.874710691" watchObservedRunningTime="2026-07-07 17:37:33.867952819 +0000 UTC m=+55.875185366" Jul 07 17:37:34.124387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.124301 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h2m5z"] Jul 07 17:37:34.126707 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.126679 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.129372 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.129335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 17:37:34.129372 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.129359 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 17:37:34.129532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.129423 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 17:37:34.129532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.129521 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 17:37:34.130642 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.130627 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\"" Jul 07 17:37:34.140039 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.140018 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2m5z"] Jul 07 17:37:34.211562 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.211521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.211960 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.211607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.211960 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.211644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-data-volume\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.211960 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.211698 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-crio-socket\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.211960 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.211726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcfwt\" (UniqueName: \"kubernetes.io/projected/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-api-access-fcfwt\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313152 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313314 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313314 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-data-volume\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313410 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.313276 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.313410 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.313371 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:34.313410 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-crio-socket\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313553 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.313427 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.813413903 +0000 UTC m=+56.820646428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : configmap "kube-rbac-proxy" not found Jul 07 17:37:34.313553 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcfwt\" (UniqueName: \"kubernetes.io/projected/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-api-access-fcfwt\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313553 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.313486 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.81347294 +0000 UTC m=+56.820705483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.313553 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-crio-socket\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.313835 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.313813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-data-volume\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.321730 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.321705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcfwt\" (UniqueName: \"kubernetes.io/projected/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-api-access-fcfwt\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.818938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.818895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.819131 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.818981 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:34.819131 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.819012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:34.819131 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.819047 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.819031207 +0000 UTC m=+57.826263746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : configmap "kube-rbac-proxy" not found Jul 07 17:37:34.819131 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.819113 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.819334 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.819183 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.819166529 +0000 UTC m=+57.826399076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.822285 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.822265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:37:34.822737 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.822721 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/0.log" Jul 07 17:37:34.822795 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.822757 2567 generic.go:356] "Generic (PLEG): container finished" podID="981d40a9-f413-4918-857b-c270bf88ee4d" containerID="95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6" exitCode=255 Jul 07 17:37:34.822862 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.822788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" event={"ID":"981d40a9-f413-4918-857b-c270bf88ee4d","Type":"ContainerDied","Data":"95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6"} Jul 07 17:37:34.822862 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.822856 2567 scope.go:117] "RemoveContainer" containerID="0d2bb573fac636cd2d47a33e6ec4fe0a929d38fb01e3a9bc8138eb07ac55f82e" Jul 07 17:37:34.823026 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:34.823004 2567 scope.go:117] "RemoveContainer" containerID="95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6" Jul 07 17:37:34.823201 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:34.823173 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qlqzp_openshift-console-operator(981d40a9-f413-4918-857b-c270bf88ee4d)\"" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" podUID="981d40a9-f413-4918-857b-c270bf88ee4d" Jul 07 17:37:35.826646 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:35.826619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:37:35.827221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:35.827039 2567 scope.go:117] "RemoveContainer" containerID="95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6" Jul 07 17:37:35.827296 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:35.827226 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qlqzp_openshift-console-operator(981d40a9-f413-4918-857b-c270bf88ee4d)\"" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" podUID="981d40a9-f413-4918-857b-c270bf88ee4d" Jul 07 17:37:35.827774 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:35.827752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:35.827893 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:35.827809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:35.827893 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:35.827860 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:35.827893 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:35.827884 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:35.828012 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:35.827906 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.827892925 +0000 UTC m=+59.835125451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : configmap "kube-rbac-proxy" not found Jul 07 17:37:35.828012 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:35.827934 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.827921895 +0000 UTC m=+59.835154424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:35.905857 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:35.905830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bnfw_4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2/dns-node-resolver/0.log" Jul 07 17:37:37.106250 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.106224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgpnx_82ead001-dfc6-4b72-bee7-afb093970c49/node-ca/0.log" Jul 07 17:37:37.367194 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.367120 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nv5sn"] Jul 07 17:37:37.369513 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.369492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.371988 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.371969 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 17:37:37.372204 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.372191 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 17:37:37.373334 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.373320 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 17:37:37.373409 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.373336 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 17:37:37.373409 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.373339 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mzp9l\"" Jul 07 17:37:37.379824 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.379807 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nv5sn"] Jul 07 17:37:37.439075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.439041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8w57\" (UniqueName: \"kubernetes.io/projected/429fac10-ba7e-444f-b858-edff0ffb3542-kube-api-access-g8w57\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.439235 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.439090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/429fac10-ba7e-444f-b858-edff0ffb3542-signing-key\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.439235 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.439181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/429fac10-ba7e-444f-b858-edff0ffb3542-signing-cabundle\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.439235 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.439226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:37.439337 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.439318 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:37.439337 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.439329 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bdc55b665-wj5gs: secret "image-registry-tls" not found Jul 07 17:37:37.439396 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.439374 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls podName:09fd33b2-e5f0-4e9a-a046-a63adb9faac4 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.43936123 +0000 UTC m=+67.446593759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls") pod "image-registry-bdc55b665-wj5gs" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4") : secret "image-registry-tls" not found Jul 07 17:37:37.539786 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.539751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/429fac10-ba7e-444f-b858-edff0ffb3542-signing-cabundle\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.539947 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.539870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8w57\" (UniqueName: \"kubernetes.io/projected/429fac10-ba7e-444f-b858-edff0ffb3542-kube-api-access-g8w57\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.539947 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.539927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/429fac10-ba7e-444f-b858-edff0ffb3542-signing-key\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.540564 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.540537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/429fac10-ba7e-444f-b858-edff0ffb3542-signing-cabundle\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.542664 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.542640 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/429fac10-ba7e-444f-b858-edff0ffb3542-signing-key\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.548013 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.547992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8w57\" (UniqueName: \"kubernetes.io/projected/429fac10-ba7e-444f-b858-edff0ffb3542-kube-api-access-g8w57\") pod \"service-ca-758f599c5-nv5sn\" (UID: \"429fac10-ba7e-444f-b858-edff0ffb3542\") " pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.678324 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.678238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nv5sn" Jul 07 17:37:37.706072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.706038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6kf7w_4ef0e22c-86c9-4d02-a1ab-a779ee296596/serve-healthcheck-canary/0.log" Jul 07 17:37:37.820474 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.820433 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nv5sn"] Jul 07 17:37:37.824206 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:37.824177 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429fac10_ba7e_444f_b858_edff0ffb3542.slice/crio-a5a3da09e6c56696ce92ad43a30269e135b1503994a71baf2f1005d56a83aea9 WatchSource:0}: Error finding container a5a3da09e6c56696ce92ad43a30269e135b1503994a71baf2f1005d56a83aea9: Status 404 returned error can't find the container with id a5a3da09e6c56696ce92ad43a30269e135b1503994a71baf2f1005d56a83aea9 Jul 07 17:37:37.832240 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.832217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nv5sn" event={"ID":"429fac10-ba7e-444f-b858-edff0ffb3542","Type":"ContainerStarted","Data":"a5a3da09e6c56696ce92ad43a30269e135b1503994a71baf2f1005d56a83aea9"} Jul 07 17:37:37.843747 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.843724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:37.843848 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:37.843768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:37.843848 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.843842 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:37.843955 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.843883 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.843870847 +0000 UTC m=+63.851103372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : configmap "kube-rbac-proxy" not found Jul 07 17:37:37.843955 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.843887 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:37.843955 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:37.843946 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.843927135 +0000 UTC m=+63.851159671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:38.837432 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:38.837391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nv5sn" event={"ID":"429fac10-ba7e-444f-b858-edff0ffb3542","Type":"ContainerStarted","Data":"41caea7d9e4d82063d268eaaa3425fa23aab0061358778e1f0641690b32d6a3b"} Jul 07 17:37:38.857577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:38.857518 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-nv5sn" podStartSLOduration=1.85749825 podStartE2EDuration="1.85749825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:38.854037039 +0000 UTC m=+60.861269614" watchObservedRunningTime="2026-07-07 17:37:38.85749825 +0000 UTC m=+60.864730800" Jul 07 17:37:39.916208 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:39.916174 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:39.916622 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:39.916257 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:39.916667 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:39.916625 2567 scope.go:117] "RemoveContainer" containerID="95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6" Jul 07 17:37:39.916797 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:39.916776 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qlqzp_openshift-console-operator(981d40a9-f413-4918-857b-c270bf88ee4d)\"" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" podUID="981d40a9-f413-4918-857b-c270bf88ee4d" Jul 07 17:37:41.755058 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:41.755030 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dnpq" Jul 07 17:37:41.877603 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:41.877541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:41.877809 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:41.877644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:41.877809 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:41.877733 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:41.877809 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:41.877775 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:41.877809 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:41.877808 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.877785813 +0000 UTC m=+71.885018352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:41.877975 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:41.877830 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm podName:4fe27e8b-4da2-4a5a-bb72-d6d302de9de7 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.877816601 +0000 UTC m=+71.885049127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h2m5z" (UID: "4fe27e8b-4da2-4a5a-bb72-d6d302de9de7") : configmap "kube-rbac-proxy" not found Jul 07 17:37:44.296761 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.296725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:44.297210 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.296781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:44.297210 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.296808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:37:44.299502 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.299480 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:37:44.299555 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.299517 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:37:44.299606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.299517 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:37:44.306996 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:44.306975 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 17:37:44.307108 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:37:44.307051 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs podName:808da2c9-ea61-4b90-815f-4aa81b55cb44 nodeName:}" failed. No retries permitted until 2026-07-07 17:38:48.30702824 +0000 UTC m=+130.314260765 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs") pod "network-metrics-daemon-5hslb" (UID: "808da2c9-ea61-4b90-815f-4aa81b55cb44") : secret "metrics-daemon-secret" not found Jul 07 17:37:44.309058 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.309037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a785ab-fa26-4afc-ad92-6201274a38e5-original-pull-secret\") pod \"global-pull-secret-syncer-x6npr\" (UID: \"41a785ab-fa26-4afc-ad92-6201274a38e5\") " pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:44.309369 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.309350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:37:44.319717 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.319697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvw5l\" (UniqueName: \"kubernetes.io/projected/4cda405d-75ba-4e1e-83a7-3e3fca819f64-kube-api-access-pvw5l\") pod \"network-check-target-l6szj\" (UID: \"4cda405d-75ba-4e1e-83a7-3e3fca819f64\") " pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:44.383419 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.383392 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\"" Jul 07 17:37:44.388613 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.388596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6npr" Jul 07 17:37:44.391079 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.391047 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:44.515892 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.515856 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6npr"] Jul 07 17:37:44.518978 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:44.518951 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a785ab_fa26_4afc_ad92_6201274a38e5.slice/crio-b7f0f493cd42466b635fb7c64278b9a81480b684bf063256b1279db47d8e846b WatchSource:0}: Error finding container b7f0f493cd42466b635fb7c64278b9a81480b684bf063256b1279db47d8e846b: Status 404 returned error can't find the container with id b7f0f493cd42466b635fb7c64278b9a81480b684bf063256b1279db47d8e846b Jul 07 17:37:44.534340 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.534311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6szj"] Jul 07 17:37:44.537072 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:44.537045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cda405d_75ba_4e1e_83a7_3e3fca819f64.slice/crio-eb9342017eea177432fb771bb8e23f66b85d4bf1d26516712e5deeabbe7a5b1b WatchSource:0}: Error finding container eb9342017eea177432fb771bb8e23f66b85d4bf1d26516712e5deeabbe7a5b1b: Status 404 returned error can't find the container with id eb9342017eea177432fb771bb8e23f66b85d4bf1d26516712e5deeabbe7a5b1b Jul 07 17:37:44.854303 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.854262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6szj" event={"ID":"4cda405d-75ba-4e1e-83a7-3e3fca819f64","Type":"ContainerStarted","Data":"eb9342017eea177432fb771bb8e23f66b85d4bf1d26516712e5deeabbe7a5b1b"} Jul 07 17:37:44.855299 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:44.855272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6npr" event={"ID":"41a785ab-fa26-4afc-ad92-6201274a38e5","Type":"ContainerStarted","Data":"b7f0f493cd42466b635fb7c64278b9a81480b684bf063256b1279db47d8e846b"} Jul 07 17:37:45.507611 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.507568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:45.510379 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.510353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"image-registry-bdc55b665-wj5gs\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:45.615383 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.615347 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hdmrj\"" Jul 07 17:37:45.623587 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.623503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:45.794984 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.794943 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:37:45.798356 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:45.798324 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fd33b2_e5f0_4e9a_a046_a63adb9faac4.slice/crio-191ac3e86f441522c509610705d9175d9793265d3d6e1d6aa2afd6573f1c90de WatchSource:0}: Error finding container 191ac3e86f441522c509610705d9175d9793265d3d6e1d6aa2afd6573f1c90de: Status 404 returned error can't find the container with id 191ac3e86f441522c509610705d9175d9793265d3d6e1d6aa2afd6573f1c90de Jul 07 17:37:45.860014 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:45.859933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" event={"ID":"09fd33b2-e5f0-4e9a-a046-a63adb9faac4","Type":"ContainerStarted","Data":"191ac3e86f441522c509610705d9175d9793265d3d6e1d6aa2afd6573f1c90de"} Jul 07 17:37:46.865271 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:46.865202 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" event={"ID":"09fd33b2-e5f0-4e9a-a046-a63adb9faac4","Type":"ContainerStarted","Data":"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6"} Jul 07 17:37:46.865899 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:46.865355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:37:46.884966 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:46.884903 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" podStartSLOduration=17.884880850000002 podStartE2EDuration="17.88488085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:46.883515203 +0000 UTC m=+68.890747777" watchObservedRunningTime="2026-07-07 17:37:46.88488085 +0000 UTC m=+68.892113402" Jul 07 17:37:49.242345 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.242302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:49.244852 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.244822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/222eeaeb-5b75-43cc-b6e7-9af69be1c957-metrics-tls\") pod \"dns-default-p4l64\" (UID: \"222eeaeb-5b75-43cc-b6e7-9af69be1c957\") " pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:49.465683 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.465649 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\"" Jul 07 17:37:49.472944 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.472914 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:49.734522 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.734489 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p4l64"] Jul 07 17:37:49.737783 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:49.737751 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222eeaeb_5b75_43cc_b6e7_9af69be1c957.slice/crio-481a956671c9fbb53f1905f3ebbcdbc281f69b5a0538d02ffc34d18314df1dd8 WatchSource:0}: Error finding container 481a956671c9fbb53f1905f3ebbcdbc281f69b5a0538d02ffc34d18314df1dd8: Status 404 returned error can't find the container with id 481a956671c9fbb53f1905f3ebbcdbc281f69b5a0538d02ffc34d18314df1dd8 Jul 07 17:37:49.879259 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.879166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6npr" event={"ID":"41a785ab-fa26-4afc-ad92-6201274a38e5","Type":"ContainerStarted","Data":"1bb3235b590223c8ab3483c4be4c026b6e47b7192c0213e73b310c16ee1ea8f3"} Jul 07 17:37:49.880404 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.880379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4l64" event={"ID":"222eeaeb-5b75-43cc-b6e7-9af69be1c957","Type":"ContainerStarted","Data":"481a956671c9fbb53f1905f3ebbcdbc281f69b5a0538d02ffc34d18314df1dd8"} Jul 07 17:37:49.881862 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.881843 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6szj" event={"ID":"4cda405d-75ba-4e1e-83a7-3e3fca819f64","Type":"ContainerStarted","Data":"00cd1022639557651869535d2c70ccc909b211a53b7b01e16a9cf74ea036d775"} Jul 07 17:37:49.881982 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.881970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:37:49.899375 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.899318 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x6npr" podStartSLOduration=66.805622306 podStartE2EDuration="1m11.899302333s" totalImagesPullingTime="5.093680027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:49.895145206 +0000 UTC m=+71.902377755" watchObservedRunningTime="2026-07-07 17:37:49.899302333 +0000 UTC m=+71.906534905" Jul 07 17:37:49.911398 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.911350 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l6szj" podStartSLOduration=66.841969239 podStartE2EDuration="1m11.911332223s" totalImagesPullingTime="5.069362984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:49.910808035 +0000 UTC m=+71.918040601" watchObservedRunningTime="2026-07-07 17:37:49.911332223 +0000 UTC m=+71.918564773" Jul 07 17:37:49.951363 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.951327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:49.951529 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.951378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:49.951885 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.951863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:49.953698 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:49.953676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fe27e8b-4da2-4a5a-bb72-d6d302de9de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2m5z\" (UID: \"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7\") " pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:50.044999 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.044967 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\"" Jul 07 17:37:50.052543 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.052520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2m5z" Jul 07 17:37:50.187031 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.186999 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2m5z"] Jul 07 17:37:50.190524 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:50.190495 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe27e8b_4da2_4a5a_bb72_d6d302de9de7.slice/crio-a2578a07f7b4d9b545c3ce080adec9ac0c369bc9d8e8fba20985b1229a6b00d8 WatchSource:0}: Error finding container a2578a07f7b4d9b545c3ce080adec9ac0c369bc9d8e8fba20985b1229a6b00d8: Status 404 returned error can't find the container with id a2578a07f7b4d9b545c3ce080adec9ac0c369bc9d8e8fba20985b1229a6b00d8 Jul 07 17:37:50.566853 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.566824 2567 scope.go:117] "RemoveContainer" containerID="95b8ae90d9fe181bef2a6bf4015161ef84a25c7e447551765df17fc3d26fc7e6" Jul 07 17:37:50.889951 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.888756 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:37:50.889951 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.888880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" event={"ID":"981d40a9-f413-4918-857b-c270bf88ee4d","Type":"ContainerStarted","Data":"3d983886156e0ca4100815a90983e9f72dadc5f706feb074fbb2f52775d20dc8"} Jul 07 17:37:50.889951 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.889820 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:50.893242 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.893208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2m5z" event={"ID":"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7","Type":"ContainerStarted","Data":"a2578a07f7b4d9b545c3ce080adec9ac0c369bc9d8e8fba20985b1229a6b00d8"} Jul 07 17:37:50.910643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:50.909648 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" podStartSLOduration=18.552652037 podStartE2EDuration="21.909627987s" totalImagesPullingTime="3.35697595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:50.909285505 +0000 UTC m=+72.916518054" watchObservedRunningTime="2026-07-07 17:37:50.909627987 +0000 UTC m=+72.916860536" Jul 07 17:37:51.890216 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.890098 2567 patch_prober.go:28] interesting pod/console-operator-68b757fb67-qlqzp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 17:37:51.890216 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.890193 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" podUID="981d40a9-f413-4918-857b-c270bf88ee4d" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 07 17:37:51.898588 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.898558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4l64" event={"ID":"222eeaeb-5b75-43cc-b6e7-9af69be1c957","Type":"ContainerStarted","Data":"f86900dc41f5ab664609609541a4a1a395df75db1d3592985c3d1a898e549dd4"} Jul 07 17:37:51.898742 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.898610 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4l64" event={"ID":"222eeaeb-5b75-43cc-b6e7-9af69be1c957","Type":"ContainerStarted","Data":"22b12578cd6ff87695c503ef1afd2f1e6708764acc61d901ab91fda490ec5b86"} Jul 07 17:37:51.898881 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.898863 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p4l64" Jul 07 17:37:51.917769 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:51.917712 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p4l64" podStartSLOduration=33.037488045 podStartE2EDuration="34.917694666s" totalImagesPullingTime="1.880206621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:51.916731037 +0000 UTC m=+73.923963585" watchObservedRunningTime="2026-07-07 17:37:51.917694666 +0000 UTC m=+73.924927214" Jul 07 17:37:52.020989 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:52.020949 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-qlqzp" Jul 07 17:37:54.911244 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:54.911205 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2m5z" event={"ID":"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7","Type":"ContainerStarted","Data":"4893c760ce43f3a10de67dc53f427e58917c4c088e6946d139ee49f60a008247"} Jul 07 17:37:55.917751 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:55.917710 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2m5z" event={"ID":"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7","Type":"ContainerStarted","Data":"91168085b0881bc143a3d357aa3838e072e333f9667cf9d9258724a7da52dd8a"} Jul 07 17:37:57.105540 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.105503 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm"] Jul 07 17:37:57.116579 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.116377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.117558 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.117502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm"] Jul 07 17:37:57.119208 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.119172 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 17:37:57.120670 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.120637 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 17:37:57.120803 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.120698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 17:37:57.121005 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.120981 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 17:37:57.207795 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.207764 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:37:57.214640 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.214614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e2ede9-453e-49fd-8e99-5eccddf80429-tmp\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.214772 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.214733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdcs\" (UniqueName: \"kubernetes.io/projected/f4e2ede9-453e-49fd-8e99-5eccddf80429-kube-api-access-6rdcs\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.214855 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.214824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e2ede9-453e-49fd-8e99-5eccddf80429-klusterlet-config\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.316114 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.316032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdcs\" (UniqueName: \"kubernetes.io/projected/f4e2ede9-453e-49fd-8e99-5eccddf80429-kube-api-access-6rdcs\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.316114 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.316117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e2ede9-453e-49fd-8e99-5eccddf80429-klusterlet-config\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.316757 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.316195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e2ede9-453e-49fd-8e99-5eccddf80429-tmp\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.317395 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.317078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e2ede9-453e-49fd-8e99-5eccddf80429-tmp\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.321934 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.321895 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4e2ede9-453e-49fd-8e99-5eccddf80429-klusterlet-config\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.330158 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.330105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdcs\" (UniqueName: \"kubernetes.io/projected/f4e2ede9-453e-49fd-8e99-5eccddf80429-kube-api-access-6rdcs\") pod \"klusterlet-addon-workmgr-56cc97f4d5-474bm\" (UID: \"f4e2ede9-453e-49fd-8e99-5eccddf80429\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.363360 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.363153 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:37:57.370941 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.370886 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.377809 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.377766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 17:37:57.378082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378048 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 17:37:57.378227 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.377595 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 17:37:57.378376 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:37:57.378509 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378492 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 17:37:57.378627 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378602 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 17:37:57.378712 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378610 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 17:37:57.378712 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378666 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6gcg\"" Jul 07 17:37:57.378886 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.378863 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 17:37:57.429234 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.429195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:37:57.518239 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.518239 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.518494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.518494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.518494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctlxk\" (UniqueName: \"kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.518494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.518369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619214 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619214 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619214 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619522 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619522 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctlxk\" (UniqueName: \"kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.619522 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.619272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.620104 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.620049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.620104 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.620071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.620295 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.620127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.621921 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.621854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.621921 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.621878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.627532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.627512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctlxk\" (UniqueName: \"kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk\") pod \"console-59c8446769-tjllx\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.687520 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.687484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:37:57.944305 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.944277 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm"] Jul 07 17:37:57.946541 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:57.946516 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e2ede9_453e_49fd_8e99_5eccddf80429.slice/crio-67f1feb0e0ebd747f90ddc895b0abc5ed11706b1e90fd78e62f642c587210556 WatchSource:0}: Error finding container 67f1feb0e0ebd747f90ddc895b0abc5ed11706b1e90fd78e62f642c587210556: Status 404 returned error can't find the container with id 67f1feb0e0ebd747f90ddc895b0abc5ed11706b1e90fd78e62f642c587210556 Jul 07 17:37:57.961310 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:57.961197 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:37:57.963816 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:37:57.963788 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22af33a_df89_46ce_9daf_8feeb665bf4a.slice/crio-867663fad3d071366502dc64135972a8dafee2453e97e914bdf38eaec0996df9 WatchSource:0}: Error finding container 867663fad3d071366502dc64135972a8dafee2453e97e914bdf38eaec0996df9: Status 404 returned error can't find the container with id 867663fad3d071366502dc64135972a8dafee2453e97e914bdf38eaec0996df9 Jul 07 17:37:58.933527 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:58.933480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2m5z" event={"ID":"4fe27e8b-4da2-4a5a-bb72-d6d302de9de7","Type":"ContainerStarted","Data":"29c8d08d10aa124aa5299d9904fd90a16a780887e5667a22bb150a6625d4b4ad"} Jul 07 17:37:58.935700 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:58.935660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8446769-tjllx" event={"ID":"b22af33a-df89-46ce-9daf-8feeb665bf4a","Type":"ContainerStarted","Data":"867663fad3d071366502dc64135972a8dafee2453e97e914bdf38eaec0996df9"} Jul 07 17:37:58.937584 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:37:58.937515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" event={"ID":"f4e2ede9-453e-49fd-8e99-5eccddf80429","Type":"ContainerStarted","Data":"67f1feb0e0ebd747f90ddc895b0abc5ed11706b1e90fd78e62f642c587210556"} Jul 07 17:38:01.905644 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:01.905451 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p4l64" Jul 07 17:38:01.922543 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:01.922483 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h2m5z" podStartSLOduration=20.35616017 podStartE2EDuration="27.922446606s" totalImagesPullingTime="7.566286436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:37:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:58.953535148 +0000 UTC m=+80.960767724" watchObservedRunningTime="2026-07-07 17:38:01.922446606 +0000 UTC m=+83.929679151" Jul 07 17:38:03.960427 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.960390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8446769-tjllx" event={"ID":"b22af33a-df89-46ce-9daf-8feeb665bf4a","Type":"ContainerStarted","Data":"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3"} Jul 07 17:38:03.962024 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.961999 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" event={"ID":"f4e2ede9-453e-49fd-8e99-5eccddf80429","Type":"ContainerStarted","Data":"0c29eb2c6856cbb2b92d364d2f997951996a5807a6bc2e4af4d4ad5f7d742861"} Jul 07 17:38:03.962231 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.962213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:38:03.963971 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.963951 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" Jul 07 17:38:03.977828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.977788 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c8446769-tjllx" podStartSLOduration=2.042850284 podStartE2EDuration="6.977775462s" totalImagesPullingTime="4.934925178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:03.976935399 +0000 UTC m=+85.984167948" watchObservedRunningTime="2026-07-07 17:38:03.977775462 +0000 UTC m=+85.985008011" Jul 07 17:38:03.993201 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:03.993152 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56cc97f4d5-474bm" podStartSLOduration=2.025880207 podStartE2EDuration="6.993139275s" totalImagesPullingTime="4.967259068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:03.99240317 +0000 UTC m=+85.999635719" watchObservedRunningTime="2026-07-07 17:38:03.993139275 +0000 UTC m=+86.000371822" Jul 07 17:38:07.213809 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:07.213775 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:38:07.687815 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:07.687769 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:07.688005 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:07.687840 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:07.692659 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:07.692638 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:07.982352 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:07.982265 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:11.122120 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.122082 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6"] Jul 07 17:38:11.125293 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.125270 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.129069 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129048 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 17:38:11.129266 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 17:38:11.129490 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129140 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 17:38:11.129566 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129148 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 17:38:11.129566 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129183 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nlrsj\"" Jul 07 17:38:11.129677 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.129276 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 17:38:11.135237 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.135216 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6"] Jul 07 17:38:11.142354 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.142328 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nl5s7"] Jul 07 17:38:11.144821 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.144803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.147229 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.147192 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 17:38:11.147229 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.147197 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4gg69\"" Jul 07 17:38:11.147632 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.147615 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 17:38:11.147764 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.147744 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 17:38:11.235766 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-metrics-client-ca\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.235950 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-wtmp\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.235950 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865zv\" (UniqueName: \"kubernetes.io/projected/71ee25ab-5800-4387-9726-ae53dc09c5d1-kube-api-access-865zv\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.235950 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.235950 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ee25ab-5800-4387-9726-ae53dc09c5d1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.235950 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-textfile\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.235993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rkpl\" (UniqueName: \"kubernetes.io/projected/017f0c33-3eaf-40a7-99da-b6ed3c72548c-kube-api-access-2rkpl\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.236016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-root\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.236071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.236098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.236150 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.236127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-tls\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.236353 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.236158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-sys\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.336939 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.336903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-metrics-client-ca\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.336939 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.336944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-wtmp\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.336970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865zv\" (UniqueName: \"kubernetes.io/projected/71ee25ab-5800-4387-9726-ae53dc09c5d1-kube-api-access-865zv\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.336988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ee25ab-5800-4387-9726-ae53dc09c5d1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-textfile\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rkpl\" (UniqueName: \"kubernetes.io/projected/017f0c33-3eaf-40a7-99da-b6ed3c72548c-kube-api-access-2rkpl\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-root\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-wtmp\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.337199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-root\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337778 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-tls\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337778 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-sys\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337778 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/017f0c33-3eaf-40a7-99da-b6ed3c72548c-sys\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337778 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-textfile\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.337778 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-metrics-client-ca\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.338024 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.337898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ee25ab-5800-4387-9726-ae53dc09c5d1-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.338221 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.338195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.339532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.339513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-tls\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.339652 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.339536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/017f0c33-3eaf-40a7-99da-b6ed3c72548c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.339712 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.339666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.339803 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.339785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71ee25ab-5800-4387-9726-ae53dc09c5d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.346561 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.346542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rkpl\" (UniqueName: \"kubernetes.io/projected/017f0c33-3eaf-40a7-99da-b6ed3c72548c-kube-api-access-2rkpl\") pod \"node-exporter-nl5s7\" (UID: \"017f0c33-3eaf-40a7-99da-b6ed3c72548c\") " pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.346921 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.346905 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-865zv\" (UniqueName: \"kubernetes.io/projected/71ee25ab-5800-4387-9726-ae53dc09c5d1-kube-api-access-865zv\") pod \"openshift-state-metrics-54cf96dfcf-bl7k6\" (UID: \"71ee25ab-5800-4387-9726-ae53dc09c5d1\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.436171 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.436084 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" Jul 07 17:38:11.455781 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.455753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nl5s7" Jul 07 17:38:11.464813 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:11.464779 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017f0c33_3eaf_40a7_99da_b6ed3c72548c.slice/crio-869aec5c5898ea43d9723d611efad29872a34c5c2875aaf6b516c7212359f919 WatchSource:0}: Error finding container 869aec5c5898ea43d9723d611efad29872a34c5c2875aaf6b516c7212359f919: Status 404 returned error can't find the container with id 869aec5c5898ea43d9723d611efad29872a34c5c2875aaf6b516c7212359f919 Jul 07 17:38:11.564782 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.564748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6"] Jul 07 17:38:11.567426 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:11.567400 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ee25ab_5800_4387_9726_ae53dc09c5d1.slice/crio-c2ec9dab058b6bd8b44be199e0407cf1d03ff07f8593ce23cd5865026c0923c4 WatchSource:0}: Error finding container c2ec9dab058b6bd8b44be199e0407cf1d03ff07f8593ce23cd5865026c0923c4: Status 404 returned error can't find the container with id c2ec9dab058b6bd8b44be199e0407cf1d03ff07f8593ce23cd5865026c0923c4 Jul 07 17:38:11.992692 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.992603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl5s7" event={"ID":"017f0c33-3eaf-40a7-99da-b6ed3c72548c","Type":"ContainerStarted","Data":"869aec5c5898ea43d9723d611efad29872a34c5c2875aaf6b516c7212359f919"} Jul 07 17:38:11.994247 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.994223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" event={"ID":"71ee25ab-5800-4387-9726-ae53dc09c5d1","Type":"ContainerStarted","Data":"ccb8de2923c436142bda48dd1ea8cde6adf3219ef989ac4d1eb61b56c21de19a"} Jul 07 17:38:11.994353 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.994266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" event={"ID":"71ee25ab-5800-4387-9726-ae53dc09c5d1","Type":"ContainerStarted","Data":"e2bb67a394c31bd755385af7e4c467e8abfcb71f3b66fcc510c3b28a86dde8d4"} Jul 07 17:38:11.994353 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:11.994282 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" event={"ID":"71ee25ab-5800-4387-9726-ae53dc09c5d1","Type":"ContainerStarted","Data":"c2ec9dab058b6bd8b44be199e0407cf1d03ff07f8593ce23cd5865026c0923c4"} Jul 07 17:38:12.204033 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.203988 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:38:12.206825 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.206799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.209531 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209506 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 17:38:12.209683 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209652 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 17:38:12.209683 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209677 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vshlk\"" Jul 07 17:38:12.209784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 17:38:12.209784 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209759 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 17:38:12.210039 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 17:38:12.210039 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209981 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 17:38:12.210039 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209988 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 17:38:12.210039 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.210006 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 17:38:12.210261 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.209983 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 17:38:12.228879 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.228779 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:38:12.348381 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.348599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9c8b\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-kube-api-access-d9c8b\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.349075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.348745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450250 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9c8b\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-kube-api-access-d9c8b\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.450840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.450727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.451327 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.451167 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.452104 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.452078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.453908 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.453854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-out\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.454020 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.453986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.454705 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.454660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.455339 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.455316 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-web-config\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.455734 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.455682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.455838 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.455752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.455891 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.455834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.455980 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.455958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.456574 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.456543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.459347 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.459325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9c8b\" (UniqueName: \"kubernetes.io/projected/4e6ac113-eb0a-486c-a56b-c1ca39b310f9-kube-api-access-d9c8b\") pod \"alertmanager-main-0\" (UID: \"4e6ac113-eb0a-486c-a56b-c1ca39b310f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.519433 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.519398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:38:12.917787 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:12.917753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:38:12.920998 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:12.920971 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ac113_eb0a_486c_a56b_c1ca39b310f9.slice/crio-ec132fd4d95bd1f58874f2256008bf5c17579fb317d1a7f3df38dbb0fcea3760 WatchSource:0}: Error finding container ec132fd4d95bd1f58874f2256008bf5c17579fb317d1a7f3df38dbb0fcea3760: Status 404 returned error can't find the container with id ec132fd4d95bd1f58874f2256008bf5c17579fb317d1a7f3df38dbb0fcea3760 Jul 07 17:38:13.001774 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.001742 2567 generic.go:356] "Generic (PLEG): container finished" podID="017f0c33-3eaf-40a7-99da-b6ed3c72548c" containerID="4f5ab4c6423fd48ccabc6b15b5e0634dd8875de46682ecf94f0ef84a6ba5a736" exitCode=0 Jul 07 17:38:13.001979 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.001817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl5s7" event={"ID":"017f0c33-3eaf-40a7-99da-b6ed3c72548c","Type":"ContainerDied","Data":"4f5ab4c6423fd48ccabc6b15b5e0634dd8875de46682ecf94f0ef84a6ba5a736"} Jul 07 17:38:13.004103 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.004079 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" event={"ID":"71ee25ab-5800-4387-9726-ae53dc09c5d1","Type":"ContainerStarted","Data":"a8c93c019feab03d3a2a270b69e521a18be87491facb39f87f001495fdaaa29c"} Jul 07 17:38:13.005183 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.005160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"ec132fd4d95bd1f58874f2256008bf5c17579fb317d1a7f3df38dbb0fcea3760"} Jul 07 17:38:13.035604 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.035562 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bl7k6" podStartSLOduration=0.951321131 podStartE2EDuration="2.035546572s" totalImagesPullingTime="1.084225441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:13.034786752 +0000 UTC m=+95.042019300" watchObservedRunningTime="2026-07-07 17:38:13.035546572 +0000 UTC m=+95.042779119" Jul 07 17:38:13.123631 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.123606 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7487c6d88c-5sfgg"] Jul 07 17:38:13.126137 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.126119 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.128890 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.128869 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 17:38:13.128993 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.128905 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fs5ph02gun1n3\"" Jul 07 17:38:13.128993 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.128905 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 17:38:13.129102 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.129045 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 17:38:13.129193 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.129178 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 17:38:13.129247 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.129199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t89cl\"" Jul 07 17:38:13.129247 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.129183 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 17:38:13.139071 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.139048 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7487c6d88c-5sfgg"] Jul 07 17:38:13.260179 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww9jh\" (UniqueName: \"kubernetes.io/projected/9bd19bb0-18a2-4485-899c-a4fb63d1da86-kube-api-access-ww9jh\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260363 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd19bb0-18a2-4485-899c-a4fb63d1da86-metrics-client-ca\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.260606 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.260441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-grpc-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361645 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd19bb0-18a2-4485-899c-a4fb63d1da86-metrics-client-ca\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361830 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-grpc-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361830 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361830 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361830 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.361830 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww9jh\" (UniqueName: \"kubernetes.io/projected/9bd19bb0-18a2-4485-899c-a4fb63d1da86-kube-api-access-ww9jh\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.362075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.361976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.362075 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.362020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.362483 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.362428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd19bb0-18a2-4485-899c-a4fb63d1da86-metrics-client-ca\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364382 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364350 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364498 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364410 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364879 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364855 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-grpc-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.364956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.364907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9bd19bb0-18a2-4485-899c-a4fb63d1da86-secret-thanos-querier-tls\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.369521 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.369500 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww9jh\" (UniqueName: \"kubernetes.io/projected/9bd19bb0-18a2-4485-899c-a4fb63d1da86-kube-api-access-ww9jh\") pod \"thanos-querier-7487c6d88c-5sfgg\" (UID: \"9bd19bb0-18a2-4485-899c-a4fb63d1da86\") " pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.436168 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.436135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:13.586079 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:13.586047 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7487c6d88c-5sfgg"] Jul 07 17:38:13.588074 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:13.588048 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd19bb0_18a2_4485_899c_a4fb63d1da86.slice/crio-13061f4024deaab4f59e9f891c52f464e484ef413e30d9e71a49d0f87e965b52 WatchSource:0}: Error finding container 13061f4024deaab4f59e9f891c52f464e484ef413e30d9e71a49d0f87e965b52: Status 404 returned error can't find the container with id 13061f4024deaab4f59e9f891c52f464e484ef413e30d9e71a49d0f87e965b52 Jul 07 17:38:14.011597 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:14.011562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl5s7" event={"ID":"017f0c33-3eaf-40a7-99da-b6ed3c72548c","Type":"ContainerStarted","Data":"052d63450584f00387eeea70b76754acaac84bcecd7e93b579a299daeb3e6dda"} Jul 07 17:38:14.011780 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:14.011621 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl5s7" event={"ID":"017f0c33-3eaf-40a7-99da-b6ed3c72548c","Type":"ContainerStarted","Data":"7837d2c83f9f5c9213454083a6d1cba4e3e01c629f915ec7838cdbc566f623f9"} Jul 07 17:38:14.012838 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:14.012806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"13061f4024deaab4f59e9f891c52f464e484ef413e30d9e71a49d0f87e965b52"} Jul 07 17:38:14.032833 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:14.032787 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nl5s7" podStartSLOduration=1.6518401759999999 podStartE2EDuration="3.032772704s" totalImagesPullingTime="1.304218103s" totalInitContainerRuntime="76.714425ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:14.031151942 +0000 UTC m=+96.038384491" watchObservedRunningTime="2026-07-07 17:38:14.032772704 +0000 UTC m=+96.040005640" Jul 07 17:38:15.019569 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.019532 2567 generic.go:356] "Generic (PLEG): container finished" podID="4e6ac113-eb0a-486c-a56b-c1ca39b310f9" containerID="ec11993a7df90dbbaf861b552e8b25b5ceb2f52b31714331e32c908abfd1476e" exitCode=0 Jul 07 17:38:15.019994 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.019625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerDied","Data":"ec11993a7df90dbbaf861b552e8b25b5ceb2f52b31714331e32c908abfd1476e"} Jul 07 17:38:15.426806 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.426770 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bc7bd4768-29hvc"] Jul 07 17:38:15.428945 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.428926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.431615 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.431592 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nkwcm\"" Jul 07 17:38:15.431761 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.431745 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 17:38:15.431828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.431792 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 17:38:15.431900 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.431820 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-15p52aahkvcaa\"" Jul 07 17:38:15.433091 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.433073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 17:38:15.433156 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.433073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 17:38:15.439550 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.439524 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bc7bd4768-29hvc"] Jul 07 17:38:15.482192 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1c04f40c-dc4b-4f03-b213-be6900e1f792-audit-log\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482192 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctwv\" (UniqueName: \"kubernetes.io/projected/1c04f40c-dc4b-4f03-b213-be6900e1f792-kube-api-access-wctwv\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482416 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-client-certs\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482416 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-client-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482552 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-metrics-server-audit-profiles\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482552 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-tls\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.482552 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.482499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583201 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-metrics-server-audit-profiles\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583351 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-tls\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583351 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583351 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1c04f40c-dc4b-4f03-b213-be6900e1f792-audit-log\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583351 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctwv\" (UniqueName: \"kubernetes.io/projected/1c04f40c-dc4b-4f03-b213-be6900e1f792-kube-api-access-wctwv\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-client-certs\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-client-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.583930 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.583809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1c04f40c-dc4b-4f03-b213-be6900e1f792-audit-log\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.584035 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.584015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.584323 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.584300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1c04f40c-dc4b-4f03-b213-be6900e1f792-metrics-server-audit-profiles\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.585857 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.585837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-tls\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.585978 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.585939 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-client-ca-bundle\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.586066 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.586044 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1c04f40c-dc4b-4f03-b213-be6900e1f792-secret-metrics-server-client-certs\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.592153 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.592133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctwv\" (UniqueName: \"kubernetes.io/projected/1c04f40c-dc4b-4f03-b213-be6900e1f792-kube-api-access-wctwv\") pod \"metrics-server-7bc7bd4768-29hvc\" (UID: \"1c04f40c-dc4b-4f03-b213-be6900e1f792\") " pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:15.738837 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:15.738597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:16.360641 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:16.360608 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bc7bd4768-29hvc"] Jul 07 17:38:16.366143 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:16.366118 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c04f40c_dc4b_4f03_b213_be6900e1f792.slice/crio-9ac30ff99a6ac96965dd84e6bd9e209743ffd9dd16c2fffbc431e124434c813a WatchSource:0}: Error finding container 9ac30ff99a6ac96965dd84e6bd9e209743ffd9dd16c2fffbc431e124434c813a: Status 404 returned error can't find the container with id 9ac30ff99a6ac96965dd84e6bd9e209743ffd9dd16c2fffbc431e124434c813a Jul 07 17:38:16.628828 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:16.628796 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:38:17.035609 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.035574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"f3972d30804cf6fc68364c61b2f5b44cbf3f648fddef54a24d7f02d5ecacd0db"} Jul 07 17:38:17.035724 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.035660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"732670f41dea5d44b31001856a8bd0597fcfd3ac7066dd6782b8fbb236a28bd1"} Jul 07 17:38:17.035724 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.035703 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"cf367f286e549b6ac4402eb1c6b44108dd9cede1926969260a605fc32a60cfce"} Jul 07 17:38:17.037684 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.037297 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" event={"ID":"1c04f40c-dc4b-4f03-b213-be6900e1f792","Type":"ContainerStarted","Data":"9ac30ff99a6ac96965dd84e6bd9e209743ffd9dd16c2fffbc431e124434c813a"} Jul 07 17:38:17.041079 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.041056 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"614833b0639d16bb2c3f92ba44308156f4d11cf8493cfe7cb71f45fb81549f2a"} Jul 07 17:38:17.041181 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.041124 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"a669113e5173b8179fb333a650fce048b9a4a473ef3f8badfc2ee37e7151a306"} Jul 07 17:38:17.041181 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.041166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"35d93003c49d05e438e0fb23616e5780497cacf53f66748f483d98673d9c1c5e"} Jul 07 17:38:17.391096 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.391055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 17:38:17.394961 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.394939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.397833 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.397810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 17:38:17.397931 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.397833 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 17:38:17.397931 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.397918 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 17:38:17.398131 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398045 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 17:38:17.398199 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398130 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 17:38:17.398273 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398246 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 17:38:17.398273 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398252 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 17:38:17.398379 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 17:38:17.398550 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398530 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4qs6a3debtt9n\"" Jul 07 17:38:17.398635 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398557 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 17:38:17.398779 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.398740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 17:38:17.399640 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.399430 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 17:38:17.399640 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.399483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 17:38:17.400555 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.400380 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-prckk\"" Jul 07 17:38:17.400642 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.400616 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 17:38:17.401585 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.401401 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 17:38:17.407077 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.406685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 17:38:17.502623 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502774 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502774 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79lq7\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-kube-api-access-79lq7\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.502894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502889 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.502989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503072 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.503316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.503286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604310 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79lq7\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-kube-api-access-79lq7\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604697 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604756 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604756 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.604867 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.604796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.605867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.606211 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.606214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.607000 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.606223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.607000 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.606786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.607131 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.607106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.607908 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.607882 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.608042 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.608003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.608797 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.608774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.608898 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.608873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.609369 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.609333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.609579 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.609546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.610136 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.610111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.610509 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.610319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.610888 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.610862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.610979 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.610874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.611085 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.611060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.612054 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.612034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.616328 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.616302 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79lq7\" (UniqueName: \"kubernetes.io/projected/8965c99c-2c27-4b3b-a9b8-161ca9e31e88-kube-api-access-79lq7\") pod \"prometheus-k8s-0\" (UID: \"8965c99c-2c27-4b3b-a9b8-161ca9e31e88\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:17.708205 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:17.708169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:18.068677 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.068643 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"d2ba6718cfce79054db5a24b3181764456505d2a1fd95ecca4081097f1161894"} Jul 07 17:38:18.068837 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.068723 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"4d2de878f9772fbbd677ddae5ef8c0d1bc71da42eabfa99bb1f87608f7c1214f"} Jul 07 17:38:18.068837 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.068765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e6ac113-eb0a-486c-a56b-c1ca39b310f9","Type":"ContainerStarted","Data":"2cd55c2e96f12bdd831a8433cf469136ca4d46c6e96856a3f10c45f803c5fd12"} Jul 07 17:38:18.072255 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.072225 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"323d969b3c2cd85e10ded96e5498cf1fdd109364f6186ac35889795fc7262771"} Jul 07 17:38:18.072384 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.072299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"ce41b415ae2273767db132298713b1bd83726016497621fe5fc053302335bc45"} Jul 07 17:38:18.072384 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.072340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" event={"ID":"9bd19bb0-18a2-4485-899c-a4fb63d1da86","Type":"ContainerStarted","Data":"63f55babc662f0f0dc0dafb1c37ca0f46a6bc02c4f5a4b892c7825710c127266"} Jul 07 17:38:18.072673 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.072654 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:18.098922 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.098866 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.755892328 podStartE2EDuration="6.098843326s" totalImagesPullingTime="3.326885132s" totalInitContainerRuntime="16.065866ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:18.097673401 +0000 UTC m=+100.104905972" watchObservedRunningTime="2026-07-07 17:38:18.098843326 +0000 UTC m=+100.106075880" Jul 07 17:38:18.121776 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.121718 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" podStartSLOduration=1.6287942069999999 podStartE2EDuration="5.121696812s" totalImagesPullingTime="3.492902605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:18.120072595 +0000 UTC m=+100.127305143" watchObservedRunningTime="2026-07-07 17:38:18.121696812 +0000 UTC m=+100.128929360" Jul 07 17:38:18.145739 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:18.145710 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 17:38:18.149050 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:18.149024 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8965c99c_2c27_4b3b_a9b8_161ca9e31e88.slice/crio-a9594361a530ac4549f7965463bbdf981a4d33c7794c1ca15713c271e24cb7d2 WatchSource:0}: Error finding container a9594361a530ac4549f7965463bbdf981a4d33c7794c1ca15713c271e24cb7d2: Status 404 returned error can't find the container with id a9594361a530ac4549f7965463bbdf981a4d33c7794c1ca15713c271e24cb7d2 Jul 07 17:38:19.078811 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:19.078767 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" event={"ID":"1c04f40c-dc4b-4f03-b213-be6900e1f792","Type":"ContainerStarted","Data":"decf9f690bb3b7f9cbdb59e1ac60c293938f84ae8bc52254be49ebb66a9830b0"} Jul 07 17:38:19.080466 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:19.080425 2567 generic.go:356] "Generic (PLEG): container finished" podID="8965c99c-2c27-4b3b-a9b8-161ca9e31e88" containerID="d2a79f9b19bc9f15bd29aea257dad8fa3bc794aba4ea9b19c20a0a06fb29f1e5" exitCode=0 Jul 07 17:38:19.080602 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:19.080514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerDied","Data":"d2a79f9b19bc9f15bd29aea257dad8fa3bc794aba4ea9b19c20a0a06fb29f1e5"} Jul 07 17:38:19.080602 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:19.080586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"a9594361a530ac4549f7965463bbdf981a4d33c7794c1ca15713c271e24cb7d2"} Jul 07 17:38:19.096796 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:19.096749 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" podStartSLOduration=2.453152678 podStartE2EDuration="4.09673451s" totalImagesPullingTime="1.643581832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:19.096402909 +0000 UTC m=+101.103635462" watchObservedRunningTime="2026-07-07 17:38:19.09673451 +0000 UTC m=+101.103967058" Jul 07 17:38:20.896166 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:20.896128 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l6szj" Jul 07 17:38:22.230818 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.230767 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" podUID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" containerName="registry" containerID="cri-o://05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6" gracePeriod=30 Jul 07 17:38:22.840494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.840448 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:38:22.959144 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959050 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959144 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959103 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959149 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959181 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959213 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959387 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959327 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54znn\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959625 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959406 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959625 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959447 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") pod \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\" (UID: \"09fd33b2-e5f0-4e9a-a046-a63adb9faac4\") " Jul 07 17:38:22.959732 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959616 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:22.960317 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.959838 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-certificates\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:22.960317 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.960266 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:22.961887 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.961861 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:22.962092 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.962007 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:22.962157 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.962120 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:22.962157 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.962140 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn" (OuterVolumeSpecName: "kube-api-access-54znn") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "kube-api-access-54znn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:22.962326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.962312 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:22.973594 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:22.973569 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "09fd33b2-e5f0-4e9a-a046-a63adb9faac4" (UID: "09fd33b2-e5f0-4e9a-a046-a63adb9faac4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:38:23.060644 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060614 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-trusted-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060644 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060644 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-registry-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060807 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060656 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-ca-trust-extracted\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060807 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060669 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-installation-pull-secrets\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060807 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060683 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-image-registry-private-configuration\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060807 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060695 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-bound-sa-token\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.060807 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.060709 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54znn\" (UniqueName: \"kubernetes.io/projected/09fd33b2-e5f0-4e9a-a046-a63adb9faac4-kube-api-access-54znn\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:23.101099 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.101068 2567 generic.go:356] "Generic (PLEG): container finished" podID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" containerID="05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6" exitCode=0 Jul 07 17:38:23.101208 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.101123 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" Jul 07 17:38:23.101208 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.101146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" event={"ID":"09fd33b2-e5f0-4e9a-a046-a63adb9faac4","Type":"ContainerDied","Data":"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6"} Jul 07 17:38:23.101208 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.101199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdc55b665-wj5gs" event={"ID":"09fd33b2-e5f0-4e9a-a046-a63adb9faac4","Type":"ContainerDied","Data":"191ac3e86f441522c509610705d9175d9793265d3d6e1d6aa2afd6573f1c90de"} Jul 07 17:38:23.101329 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.101220 2567 scope.go:117] "RemoveContainer" containerID="05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6" Jul 07 17:38:23.109395 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.109376 2567 scope.go:117] "RemoveContainer" containerID="05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6" Jul 07 17:38:23.109733 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:38:23.109710 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6\": container with ID starting with 05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6 not found: ID does not exist" containerID="05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6" Jul 07 17:38:23.109812 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.109741 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6"} err="failed to get container status \"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6\": rpc error: code = NotFound desc = could not find container \"05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6\": container with ID starting with 05122b04321507ffa16aba7c23d92b67b0f7b72fa820cfdafc069d152ea124b6 not found: ID does not exist" Jul 07 17:38:23.125876 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.125850 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:38:23.129219 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:23.129196 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bdc55b665-wj5gs"] Jul 07 17:38:24.088744 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.088715 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7487c6d88c-5sfgg" Jul 07 17:38:24.112973 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.112940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"8b51f1109296dfdd9ece4568a23e26638dfa4f3bdbcc2e859a107eb61bfe3db5"} Jul 07 17:38:24.114228 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.114099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"b9eb980b300dc5643d407915077e4b0db58775756ad3a1756d0a1e881f6c5c18"} Jul 07 17:38:24.114228 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.114158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"164b49bca3106034599d6ba1bde0e2e3e3eb10ee1e83a9e1978ee7277254c1a4"} Jul 07 17:38:24.114228 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.114223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"20d2560428da50bb75530e5d756473cfeb1b1c4809ba4003ac75c5169036efae"} Jul 07 17:38:24.114450 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.114264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"ae1e77d30cae124dce56bcbcda4dfec61245323d98e327f34ca58bcfa4197a7f"} Jul 07 17:38:24.114450 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.114307 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8965c99c-2c27-4b3b-a9b8-161ca9e31e88","Type":"ContainerStarted","Data":"f709b18a58ce63246350e85412e1c258d89220f53f4e16eaee9bbac0f2178de6"} Jul 07 17:38:24.145026 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.144968 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.172941572 podStartE2EDuration="7.144952193s" totalImagesPullingTime="3.948362193s" totalInitContainerRuntime="23.648428ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:24.142833604 +0000 UTC m=+106.150066222" watchObservedRunningTime="2026-07-07 17:38:24.144952193 +0000 UTC m=+106.152184741" Jul 07 17:38:24.572060 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:24.572027 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" path="/var/lib/kubelet/pods/09fd33b2-e5f0-4e9a-a046-a63adb9faac4/volumes" Jul 07 17:38:27.709157 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:27.709122 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:38:35.739576 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:35.739541 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:35.740034 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:35.739631 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:41.651945 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:41.651885 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59c8446769-tjllx" podUID="b22af33a-df89-46ce-9daf-8feeb665bf4a" containerName="console" containerID="cri-o://6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3" gracePeriod=15 Jul 07 17:38:41.893480 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:41.893443 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:42.042108 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042075 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042311 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042120 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042311 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042200 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042311 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042222 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctlxk\" (UniqueName: \"kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042311 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042294 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042540 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042327 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config\") pod \"b22af33a-df89-46ce-9daf-8feeb665bf4a\" (UID: \"b22af33a-df89-46ce-9daf-8feeb665bf4a\") " Jul 07 17:38:42.042623 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042590 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:42.042709 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042681 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:42.042844 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042734 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.042844 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042748 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-oauth-serving-cert\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.042959 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.042874 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config" (OuterVolumeSpecName: "console-config") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:42.044618 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.044594 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:42.044720 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.044594 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk" (OuterVolumeSpecName: "kube-api-access-ctlxk") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "kube-api-access-ctlxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:42.044720 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.044636 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b22af33a-df89-46ce-9daf-8feeb665bf4a" (UID: "b22af33a-df89-46ce-9daf-8feeb665bf4a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:42.143901 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.143856 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-oauth-config\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.143901 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.143899 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctlxk\" (UniqueName: \"kubernetes.io/projected/b22af33a-df89-46ce-9daf-8feeb665bf4a-kube-api-access-ctlxk\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.143901 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.143909 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-serving-cert\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.143901 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.143920 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22af33a-df89-46ce-9daf-8feeb665bf4a-console-config\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:38:42.187913 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.187873 2567 generic.go:356] "Generic (PLEG): container finished" podID="b22af33a-df89-46ce-9daf-8feeb665bf4a" containerID="6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3" exitCode=0 Jul 07 17:38:42.188080 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.187920 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c8446769-tjllx" Jul 07 17:38:42.188080 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.187956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8446769-tjllx" event={"ID":"b22af33a-df89-46ce-9daf-8feeb665bf4a","Type":"ContainerDied","Data":"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3"} Jul 07 17:38:42.188080 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.188005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c8446769-tjllx" event={"ID":"b22af33a-df89-46ce-9daf-8feeb665bf4a","Type":"ContainerDied","Data":"867663fad3d071366502dc64135972a8dafee2453e97e914bdf38eaec0996df9"} Jul 07 17:38:42.188080 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.188027 2567 scope.go:117] "RemoveContainer" containerID="6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3" Jul 07 17:38:42.196438 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.196421 2567 scope.go:117] "RemoveContainer" containerID="6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3" Jul 07 17:38:42.196719 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:38:42.196703 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3\": container with ID starting with 6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3 not found: ID does not exist" containerID="6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3" Jul 07 17:38:42.196757 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.196727 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3"} err="failed to get container status \"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3\": rpc error: code = NotFound desc = could not find container \"6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3\": container with ID starting with 6736ae2b26250c46e442e05e9985a591e44aacf42ba0be21b2b469b6fb10dda3 not found: ID does not exist" Jul 07 17:38:42.208229 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.208201 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:38:42.212282 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.212260 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c8446769-tjllx"] Jul 07 17:38:42.571578 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:42.571543 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b22af33a-df89-46ce-9daf-8feeb665bf4a" path="/var/lib/kubelet/pods/b22af33a-df89-46ce-9daf-8feeb665bf4a/volumes" Jul 07 17:38:48.399365 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:48.399325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:38:48.401618 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:48.401597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/808da2c9-ea61-4b90-815f-4aa81b55cb44-metrics-certs\") pod \"network-metrics-daemon-5hslb\" (UID: \"808da2c9-ea61-4b90-815f-4aa81b55cb44\") " pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:38:48.596956 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:48.596929 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\"" Jul 07 17:38:48.605296 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:48.605275 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hslb" Jul 07 17:38:48.767524 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:48.767489 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hslb"] Jul 07 17:38:48.770522 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:38:48.770493 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808da2c9_ea61_4b90_815f_4aa81b55cb44.slice/crio-b8eaa6d6978f6b312d2d65eda1f4b043f4029a61055a637873fa6e933fe9a0bf WatchSource:0}: Error finding container b8eaa6d6978f6b312d2d65eda1f4b043f4029a61055a637873fa6e933fe9a0bf: Status 404 returned error can't find the container with id b8eaa6d6978f6b312d2d65eda1f4b043f4029a61055a637873fa6e933fe9a0bf Jul 07 17:38:49.215532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:49.215501 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hslb" event={"ID":"808da2c9-ea61-4b90-815f-4aa81b55cb44","Type":"ContainerStarted","Data":"b8eaa6d6978f6b312d2d65eda1f4b043f4029a61055a637873fa6e933fe9a0bf"} Jul 07 17:38:50.220931 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:50.220905 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hslb" event={"ID":"808da2c9-ea61-4b90-815f-4aa81b55cb44","Type":"ContainerStarted","Data":"b947137ab6d9148be634dd53dc89c5f369002ed022fa32fab679c3b9cdda3109"} Jul 07 17:38:51.226976 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:51.226932 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hslb" event={"ID":"808da2c9-ea61-4b90-815f-4aa81b55cb44","Type":"ContainerStarted","Data":"c3df6df9c8a8011a30d80a298f71be74e1a81174b307b7d088f1cedd21e4bc78"} Jul 07 17:38:51.242350 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:51.242289 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5hslb" podStartSLOduration=131.879325087 podStartE2EDuration="2m13.24227066s" totalImagesPullingTime="1.362945573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:51.242067362 +0000 UTC m=+133.249299932" watchObservedRunningTime="2026-07-07 17:38:51.24227066 +0000 UTC m=+133.249503210" Jul 07 17:38:55.744437 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:55.744408 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:55.748194 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:55.748170 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bc7bd4768-29hvc" Jul 07 17:38:59.263235 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.263199 2567 generic.go:356] "Generic (PLEG): container finished" podID="4b84d039-1ed8-43ca-92f8-dfc8e0381259" containerID="8a38ee52d1e75780c2dfede18c8b50d61078af595df09fe9211e32041a8bc68d" exitCode=0 Jul 07 17:38:59.263733 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.263281 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" event={"ID":"4b84d039-1ed8-43ca-92f8-dfc8e0381259","Type":"ContainerDied","Data":"8a38ee52d1e75780c2dfede18c8b50d61078af595df09fe9211e32041a8bc68d"} Jul 07 17:38:59.263733 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.263728 2567 scope.go:117] "RemoveContainer" containerID="8a38ee52d1e75780c2dfede18c8b50d61078af595df09fe9211e32041a8bc68d" Jul 07 17:38:59.264816 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.264798 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a35f343-d19d-4251-9f8d-097469997f47" containerID="0d209d9f5a8753191280c776ef81aa1cb76b90275174039a8abbe436327944fc" exitCode=0 Jul 07 17:38:59.264896 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.264860 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" event={"ID":"4a35f343-d19d-4251-9f8d-097469997f47","Type":"ContainerDied","Data":"0d209d9f5a8753191280c776ef81aa1cb76b90275174039a8abbe436327944fc"} Jul 07 17:38:59.265138 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:38:59.265120 2567 scope.go:117] "RemoveContainer" containerID="0d209d9f5a8753191280c776ef81aa1cb76b90275174039a8abbe436327944fc" Jul 07 17:39:00.271345 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:00.271305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vfjt2" event={"ID":"4b84d039-1ed8-43ca-92f8-dfc8e0381259","Type":"ContainerStarted","Data":"803177f67aeb57e5d37b5fdc41ad304f1cf42bee1c32bba8905602d18aedc48d"} Jul 07 17:39:00.273316 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:00.273287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zbmxj" event={"ID":"4a35f343-d19d-4251-9f8d-097469997f47","Type":"ContainerStarted","Data":"fe391bf9ea44667712447e95888e76838c8262c5750a0bc15ea243dcc99b9b88"} Jul 07 17:39:17.708869 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:17.708818 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:39:17.729034 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:17.729004 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:39:18.367388 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:18.367361 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 17:39:35.457770 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.457673 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx"] Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458043 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" containerName="registry" Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458059 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" containerName="registry" Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458086 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22af33a-df89-46ce-9daf-8feeb665bf4a" containerName="console" Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458094 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22af33a-df89-46ce-9daf-8feeb665bf4a" containerName="console" Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458150 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09fd33b2-e5f0-4e9a-a046-a63adb9faac4" containerName="registry" Jul 07 17:39:35.458215 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.458161 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22af33a-df89-46ce-9daf-8feeb665bf4a" containerName="console" Jul 07 17:39:35.460295 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.460278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.462832 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.462809 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 17:39:35.462949 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.462809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 17:39:35.462949 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.462905 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 17:39:35.463035 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.463012 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 17:39:35.463216 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.463199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 17:39:35.463253 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.463205 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hmzkn\"" Jul 07 17:39:35.468237 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.468044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 17:39:35.472662 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.472638 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx"] Jul 07 17:39:35.594377 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594377 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-serving-certs-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594668 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594668 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-federate-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594668 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594668 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9pv\" (UniqueName: \"kubernetes.io/projected/7f359c3e-196b-4d52-8b11-aee71e3bb204-kube-api-access-lf9pv\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594668 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.594847 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.594709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-metrics-client-ca\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695183 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-metrics-client-ca\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695370 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695370 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-serving-certs-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695370 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695573 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-federate-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695573 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695573 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9pv\" (UniqueName: \"kubernetes.io/projected/7f359c3e-196b-4d52-8b11-aee71e3bb204-kube-api-access-lf9pv\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.695573 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.695535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.696093 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.696051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-metrics-client-ca\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.696261 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.696101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-serving-certs-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.696389 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.696279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.702872 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.698404 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.702872 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.698574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-telemeter-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.702872 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.698592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-secret-telemeter-client\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.703815 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.703790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7f359c3e-196b-4d52-8b11-aee71e3bb204-federate-client-tls\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.704185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.704165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9pv\" (UniqueName: \"kubernetes.io/projected/7f359c3e-196b-4d52-8b11-aee71e3bb204-kube-api-access-lf9pv\") pod \"telemeter-client-ff4f4c56d-fxjsx\" (UID: \"7f359c3e-196b-4d52-8b11-aee71e3bb204\") " pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.771372 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.771280 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" Jul 07 17:39:35.904859 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:35.904829 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx"] Jul 07 17:39:35.908279 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:39:35.908251 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f359c3e_196b_4d52_8b11_aee71e3bb204.slice/crio-cf4a5864723978c9d1a71ed615d516ebde9c6a143d3b6c044df8cace8fa6e855 WatchSource:0}: Error finding container cf4a5864723978c9d1a71ed615d516ebde9c6a143d3b6c044df8cace8fa6e855: Status 404 returned error can't find the container with id cf4a5864723978c9d1a71ed615d516ebde9c6a143d3b6c044df8cace8fa6e855 Jul 07 17:39:36.422654 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:36.422614 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" event={"ID":"7f359c3e-196b-4d52-8b11-aee71e3bb204","Type":"ContainerStarted","Data":"cf4a5864723978c9d1a71ed615d516ebde9c6a143d3b6c044df8cace8fa6e855"} Jul 07 17:39:38.433148 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:38.433110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" event={"ID":"7f359c3e-196b-4d52-8b11-aee71e3bb204","Type":"ContainerStarted","Data":"05989edb182b5be511996d459441d1cdef379e15fa2f0e21817ab9e968b266eb"} Jul 07 17:39:38.433680 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:38.433170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" event={"ID":"7f359c3e-196b-4d52-8b11-aee71e3bb204","Type":"ContainerStarted","Data":"2f24f3b8bc24f62b038792adcb296c42ea8930ecbc7f8678b8bfba48641b5a4e"} Jul 07 17:39:38.433680 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:38.433197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" event={"ID":"7f359c3e-196b-4d52-8b11-aee71e3bb204","Type":"ContainerStarted","Data":"094b76576376d5bd4342544df030823b043961e55b6ad98b960186794805bb7c"} Jul 07 17:39:38.454115 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:39:38.454062 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-ff4f4c56d-fxjsx" podStartSLOduration=1.886272204 podStartE2EDuration="3.454046314s" totalImagesPullingTime="1.56777411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:38.453859468 +0000 UTC m=+180.461092016" watchObservedRunningTime="2026-07-07 17:39:38.454046314 +0000 UTC m=+180.461278861" Jul 07 17:41:38.388440 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:38.388403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:41:38.389701 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:38.389678 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:41:38.399673 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:38.399652 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 17:41:43.674839 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.674805 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4"] Jul 07 17:41:43.677275 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.677254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.679843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.679818 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8q5s2\"" Jul 07 17:41:43.679843 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.679831 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 17:41:43.680267 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.680247 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:41:43.688654 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.688630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4"] Jul 07 17:41:43.805247 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.805208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdwp\" (UniqueName: \"kubernetes.io/projected/c67fb1b7-98a2-4903-b004-5247fda9b554-kube-api-access-dwdwp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.805247 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.805261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c67fb1b7-98a2-4903-b004-5247fda9b554-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.906325 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.906288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c67fb1b7-98a2-4903-b004-5247fda9b554-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.906515 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.906410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdwp\" (UniqueName: \"kubernetes.io/projected/c67fb1b7-98a2-4903-b004-5247fda9b554-kube-api-access-dwdwp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.906712 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.906693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c67fb1b7-98a2-4903-b004-5247fda9b554-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.914599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.914574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdwp\" (UniqueName: \"kubernetes.io/projected/c67fb1b7-98a2-4903-b004-5247fda9b554-kube-api-access-dwdwp\") pod \"openshift-lws-operator-fd8ccff4c-2h8s4\" (UID: \"c67fb1b7-98a2-4903-b004-5247fda9b554\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:43.994804 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:43.994716 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" Jul 07 17:41:44.120331 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.120305 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4"] Jul 07 17:41:44.122779 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:41:44.122750 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc67fb1b7_98a2_4903_b004_5247fda9b554.slice/crio-1a588931b822a137254a202e45c5029240a371ff85f03b5e7c50eb0cb3dd7b44 WatchSource:0}: Error finding container 1a588931b822a137254a202e45c5029240a371ff85f03b5e7c50eb0cb3dd7b44: Status 404 returned error can't find the container with id 1a588931b822a137254a202e45c5029240a371ff85f03b5e7c50eb0cb3dd7b44 Jul 07 17:41:44.124256 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.124238 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:41:44.470449 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.470417 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qq4cn"] Jul 07 17:41:44.474708 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.474690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.477301 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.477285 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 17:41:44.477386 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.477347 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 17:41:44.478643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.478621 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cllhh\"" Jul 07 17:41:44.483299 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.483276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qq4cn"] Jul 07 17:41:44.613054 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.613016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4h4\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-kube-api-access-4x4h4\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.613227 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.613069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-bound-sa-token\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.713579 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.713542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-bound-sa-token\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.713942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.713634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4h4\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-kube-api-access-4x4h4\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.721770 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.721707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-bound-sa-token\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.721995 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.721974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4h4\" (UniqueName: \"kubernetes.io/projected/339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e-kube-api-access-4x4h4\") pod \"cert-manager-55b4d954d5-qq4cn\" (UID: \"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e\") " pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.784437 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.784402 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qq4cn" Jul 07 17:41:44.915645 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.915584 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qq4cn"] Jul 07 17:41:44.919620 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:41:44.919589 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod339d3b8a_c8b2_44f5_b8e3_9c3e6fcf607e.slice/crio-b22c9295a531b980d6bc5c1775075ed028a25e33b0f94c9f23156364fdd0fedb WatchSource:0}: Error finding container b22c9295a531b980d6bc5c1775075ed028a25e33b0f94c9f23156364fdd0fedb: Status 404 returned error can't find the container with id b22c9295a531b980d6bc5c1775075ed028a25e33b0f94c9f23156364fdd0fedb Jul 07 17:41:44.949250 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.949214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" event={"ID":"c67fb1b7-98a2-4903-b004-5247fda9b554","Type":"ContainerStarted","Data":"1a588931b822a137254a202e45c5029240a371ff85f03b5e7c50eb0cb3dd7b44"} Jul 07 17:41:44.950969 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:44.950941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qq4cn" event={"ID":"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e","Type":"ContainerStarted","Data":"b22c9295a531b980d6bc5c1775075ed028a25e33b0f94c9f23156364fdd0fedb"} Jul 07 17:41:48.974469 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:48.974361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qq4cn" event={"ID":"339d3b8a-c8b2-44f5-b8e3-9c3e6fcf607e","Type":"ContainerStarted","Data":"16dd70c4b211a87183bbdc04833dd844ea1f97de92bd89b4610ccd11f8ba0cb5"} Jul 07 17:41:48.975907 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:48.975883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" event={"ID":"c67fb1b7-98a2-4903-b004-5247fda9b554","Type":"ContainerStarted","Data":"31521d1e355cb18b8cb76be8f2a8d70b89ea107470c30b6606c086dd61a9d28d"} Jul 07 17:41:48.991925 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:48.991866 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qq4cn" podStartSLOduration=1.289633531 podStartE2EDuration="4.991848047s" totalImagesPullingTime="3.702214516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:48.990136496 +0000 UTC m=+310.997369046" watchObservedRunningTime="2026-07-07 17:41:48.991848047 +0000 UTC m=+310.999080597" Jul 07 17:41:49.006326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:41:49.006253 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2h8s4" podStartSLOduration=1.5546341049999999 podStartE2EDuration="6.006239574s" totalImagesPullingTime="4.451605469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:49.005285296 +0000 UTC m=+311.012517846" watchObservedRunningTime="2026-07-07 17:41:49.006239574 +0000 UTC m=+311.013472121" Jul 07 17:42:10.407645 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.407613 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49"] Jul 07 17:42:10.473910 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.473877 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49"] Jul 07 17:42:10.474065 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.474000 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.477200 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.477167 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 17:42:10.477397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.477176 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 17:42:10.477397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.477217 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 17:42:10.477397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.477230 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lj49x\"" Jul 07 17:42:10.477397 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.477225 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 17:42:10.547820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.547783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.547995 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.547862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.547995 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.547891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.547995 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.547938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.547995 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.547964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xktz\" (UniqueName: \"kubernetes.io/projected/0536145f-aecc-4d7e-bc77-33a44990ff6b-kube-api-access-6xktz\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649204 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649204 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xktz\" (UniqueName: \"kubernetes.io/projected/0536145f-aecc-4d7e-bc77-33a44990ff6b-kube-api-access-6xktz\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649630 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649684 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.649928 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.649907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.651665 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.651642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0536145f-aecc-4d7e-bc77-33a44990ff6b-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.651874 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.651859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.651945 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.651928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0536145f-aecc-4d7e-bc77-33a44990ff6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.657539 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.657515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xktz\" (UniqueName: \"kubernetes.io/projected/0536145f-aecc-4d7e-bc77-33a44990ff6b-kube-api-access-6xktz\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-kfw49\" (UID: \"0536145f-aecc-4d7e-bc77-33a44990ff6b\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.784563 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.784534 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:10.946188 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:10.946156 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49"] Jul 07 17:42:10.949379 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:42:10.949351 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0536145f_aecc_4d7e_bc77_33a44990ff6b.slice/crio-82b39d8a021cbbf5cc45868d55b0511220771a28adc1a36aa3f88703747da6ba WatchSource:0}: Error finding container 82b39d8a021cbbf5cc45868d55b0511220771a28adc1a36aa3f88703747da6ba: Status 404 returned error can't find the container with id 82b39d8a021cbbf5cc45868d55b0511220771a28adc1a36aa3f88703747da6ba Jul 07 17:42:11.071608 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:11.071523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" event={"ID":"0536145f-aecc-4d7e-bc77-33a44990ff6b","Type":"ContainerStarted","Data":"82b39d8a021cbbf5cc45868d55b0511220771a28adc1a36aa3f88703747da6ba"} Jul 07 17:42:15.092426 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:15.092384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" event={"ID":"0536145f-aecc-4d7e-bc77-33a44990ff6b","Type":"ContainerStarted","Data":"2d03c3db266a85493a98c5641ead536c63529abe81673d08c6e586ce037a372f"} Jul 07 17:42:16.098426 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:16.098389 2567 generic.go:356] "Generic (PLEG): container finished" podID="0536145f-aecc-4d7e-bc77-33a44990ff6b" containerID="2d03c3db266a85493a98c5641ead536c63529abe81673d08c6e586ce037a372f" exitCode=0 Jul 07 17:42:16.098819 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:16.098478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" event={"ID":"0536145f-aecc-4d7e-bc77-33a44990ff6b","Type":"ContainerDied","Data":"2d03c3db266a85493a98c5641ead536c63529abe81673d08c6e586ce037a372f"} Jul 07 17:42:17.105518 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:17.105481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" event={"ID":"0536145f-aecc-4d7e-bc77-33a44990ff6b","Type":"ContainerStarted","Data":"f31d915813da6c2e163fcc5d7fbc00f1fc30bfa05910d03a659a0584cb69da84"} Jul 07 17:42:17.105917 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:17.105630 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:17.132989 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:17.132935 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" podStartSLOduration=2.466387873 podStartE2EDuration="7.132916934s" totalImagesPullingTime="3.589811482s" totalInitContainerRuntime="1.076717579s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:17.131304448 +0000 UTC m=+339.138537049" watchObservedRunningTime="2026-07-07 17:42:17.132916934 +0000 UTC m=+339.140149484" Jul 07 17:42:28.112781 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:28.112744 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-kfw49" Jul 07 17:42:37.688416 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.688336 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4"] Jul 07 17:42:37.691836 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.691815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.694596 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.694573 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 17:42:37.694711 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.694580 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-smfhc\"" Jul 07 17:42:37.695860 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.695842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 17:42:37.695939 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.695909 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 17:42:37.700530 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.700508 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4"] Jul 07 17:42:37.792061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.792016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhbnn\" (UniqueName: \"kubernetes.io/projected/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-kube-api-access-fhbnn\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.792061 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.792070 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.792266 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.792136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.792266 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.792168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.892684 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.892632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhbnn\" (UniqueName: \"kubernetes.io/projected/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-kube-api-access-fhbnn\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.892875 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.892699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.892875 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.892733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.892875 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.892753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.893371 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.893337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.895297 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.895274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.895379 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.895322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-cert\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:37.901672 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:37.901652 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhbnn\" (UniqueName: \"kubernetes.io/projected/e30fa959-dcac-45ce-9d52-fdd5c70b1c61-kube-api-access-fhbnn\") pod \"lws-controller-manager-55cbfbc7c9-blkl4\" (UID: \"e30fa959-dcac-45ce-9d52-fdd5c70b1c61\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:38.001469 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.001387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:38.132837 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.132798 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4"] Jul 07 17:42:38.136933 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:42:38.136899 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30fa959_dcac_45ce_9d52_fdd5c70b1c61.slice/crio-701791c28a9d2bac3b0cd3e9f3dce533c47b4da18f7add0dd158c171ae18babd WatchSource:0}: Error finding container 701791c28a9d2bac3b0cd3e9f3dce533c47b4da18f7add0dd158c171ae18babd: Status 404 returned error can't find the container with id 701791c28a9d2bac3b0cd3e9f3dce533c47b4da18f7add0dd158c171ae18babd Jul 07 17:42:38.195942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.195901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" event={"ID":"e30fa959-dcac-45ce-9d52-fdd5c70b1c61","Type":"ContainerStarted","Data":"701791c28a9d2bac3b0cd3e9f3dce533c47b4da18f7add0dd158c171ae18babd"} Jul 07 17:42:38.983018 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.982974 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5"] Jul 07 17:42:38.986520 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.986502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:38.989577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.989379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 17:42:38.989577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.989488 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 17:42:38.989577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.989505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 17:42:38.989577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.989498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 17:42:38.989577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.989498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 17:42:38.990760 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.990737 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqksc\"" Jul 07 17:42:38.990922 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.990767 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 17:42:38.998810 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:38.998787 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5"] Jul 07 17:42:39.102911 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.102878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l7s7\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-kube-api-access-4l7s7\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.102911 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.102924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.103158 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.103049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/705cf88f-bd13-40d9-88eb-344f15171e40-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.103158 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.103090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.103158 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.103127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.103158 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.103153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.103364 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.103185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204074 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/705cf88f-bd13-40d9-88eb-344f15171e40-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204074 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204315 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204315 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204315 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204315 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l7s7\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-kube-api-access-4l7s7\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.204729 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.204314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.205043 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.205017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.206889 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.206847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/705cf88f-bd13-40d9-88eb-344f15171e40-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.207051 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.207026 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.207119 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.207070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.207119 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.207111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/705cf88f-bd13-40d9-88eb-344f15171e40-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.226692 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.226664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l7s7\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-kube-api-access-4l7s7\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.227236 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.227217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/705cf88f-bd13-40d9-88eb-344f15171e40-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-42sb5\" (UID: \"705cf88f-bd13-40d9-88eb-344f15171e40\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.297750 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.297719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:39.708546 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:39.708422 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5"] Jul 07 17:42:39.710523 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:42:39.710495 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705cf88f_bd13_40d9_88eb_344f15171e40.slice/crio-7b0935be752700bcf24a803953ccf19c5a9a8dd590c921ae20ea039e782b8a60 WatchSource:0}: Error finding container 7b0935be752700bcf24a803953ccf19c5a9a8dd590c921ae20ea039e782b8a60: Status 404 returned error can't find the container with id 7b0935be752700bcf24a803953ccf19c5a9a8dd590c921ae20ea039e782b8a60 Jul 07 17:42:40.210746 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:40.210663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" event={"ID":"e30fa959-dcac-45ce-9d52-fdd5c70b1c61","Type":"ContainerStarted","Data":"9f645ab1d8bc07bdd01f3741c5daba6ab70ef739d34ba9ac9cc886b2b0b04d13"} Jul 07 17:42:40.211188 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:40.210872 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:42:40.213570 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:40.213526 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" event={"ID":"705cf88f-bd13-40d9-88eb-344f15171e40","Type":"ContainerStarted","Data":"7b0935be752700bcf24a803953ccf19c5a9a8dd590c921ae20ea039e782b8a60"} Jul 07 17:42:40.234349 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:40.234287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" podStartSLOduration=1.762574518 podStartE2EDuration="3.234264789s" totalImagesPullingTime="1.471690271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:40.232603145 +0000 UTC m=+362.239835717" watchObservedRunningTime="2026-07-07 17:42:40.234264789 +0000 UTC m=+362.241497339" Jul 07 17:42:41.914536 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:41.914484 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 17:42:41.914903 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:41.914557 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 17:42:42.225632 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:42.225539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" event={"ID":"705cf88f-bd13-40d9-88eb-344f15171e40","Type":"ContainerStarted","Data":"e15cde55dc2276191377b991c359ce6b7b0b349298977877cdfc25e666f10e20"} Jul 07 17:42:42.225873 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:42.225774 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:42.227348 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:42.227316 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-42sb5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 17:42:42.227491 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:42.227373 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" podUID="705cf88f-bd13-40d9-88eb-344f15171e40" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 17:42:42.254849 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:42.254800 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" podStartSLOduration=2.053192112 podStartE2EDuration="4.254786263s" totalImagesPullingTime="2.201594151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:42.2521016 +0000 UTC m=+364.259334197" watchObservedRunningTime="2026-07-07 17:42:42.254786263 +0000 UTC m=+364.262018811" Jul 07 17:42:43.233490 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:43.231447 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-42sb5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 17:42:43.233490 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:43.231557 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" podUID="705cf88f-bd13-40d9-88eb-344f15171e40" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 17:42:46.231750 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:46.231719 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-42sb5" Jul 07 17:42:51.220532 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:42:51.220500 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-blkl4" Jul 07 17:44:29.753661 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.753631 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q"] Jul 07 17:44:29.757110 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.757088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:29.759881 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.759861 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 17:44:29.759881 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.759879 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8wt5d\"" Jul 07 17:44:29.760050 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.759864 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 17:44:29.767731 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.767704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q"] Jul 07 17:44:29.895398 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.895361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmj7q\" (UniqueName: \"kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:29.895398 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.895399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:29.996671 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.996636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmj7q\" (UniqueName: \"kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:29.996840 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.996676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:29.997056 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:29.997040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:30.004689 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.004633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmj7q\" (UniqueName: \"kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:30.068727 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.068702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:30.206694 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.206551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q"] Jul 07 17:44:30.209906 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:44:30.209877 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4e8842_1bdf_4042_b8b6_67678029fb5c.slice/crio-3eb53aba8efcac72a9a33d635aff268c0b5db7099a3e676b40f4ced7106cbf7f WatchSource:0}: Error finding container 3eb53aba8efcac72a9a33d635aff268c0b5db7099a3e676b40f4ced7106cbf7f: Status 404 returned error can't find the container with id 3eb53aba8efcac72a9a33d635aff268c0b5db7099a3e676b40f4ced7106cbf7f Jul 07 17:44:30.548352 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.548318 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q"] Jul 07 17:44:30.552495 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.552471 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q"] Jul 07 17:44:30.579110 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.579082 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:44:30.583982 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.583960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.597741 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.597715 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:44:30.703298 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.703266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf897\" (UniqueName: \"kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.703443 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.703334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.804639 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.804552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf897\" (UniqueName: \"kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.804639 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.804596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.805044 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.805031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.815094 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.815069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf897\" (UniqueName: \"kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9bngc\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:30.896980 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:30.896942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:31.074649 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:31.074572 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:44:31.127062 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:44:31.127030 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceef8c13_6778_4f31_8b41_326d2d7488a8.slice/crio-38333053d99e328e5615568424247fd86798938e53a53cdba4cf7db7bb47ac51 WatchSource:0}: Error finding container 38333053d99e328e5615568424247fd86798938e53a53cdba4cf7db7bb47ac51: Status 404 returned error can't find the container with id 38333053d99e328e5615568424247fd86798938e53a53cdba4cf7db7bb47ac51 Jul 07 17:44:31.718076 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:31.718006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" event={"ID":"ceef8c13-6778-4f31-8b41-326d2d7488a8","Type":"ContainerStarted","Data":"38333053d99e328e5615568424247fd86798938e53a53cdba4cf7db7bb47ac51"} Jul 07 17:44:36.746645 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:36.746606 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" event={"ID":"ceef8c13-6778-4f31-8b41-326d2d7488a8","Type":"ContainerStarted","Data":"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97"} Jul 07 17:44:36.747127 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:36.746749 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:36.748326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:36.748286 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" containerName="manager" containerID="cri-o://7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d" gracePeriod=2 Jul 07 17:44:36.767496 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:36.767436 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" podStartSLOduration=2.15144557 podStartE2EDuration="6.767421314s" totalImagesPullingTime="4.615975744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:36.765688641 +0000 UTC m=+478.772921225" watchObservedRunningTime="2026-07-07 17:44:36.767421314 +0000 UTC m=+478.774653862" Jul 07 17:44:36.981024 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:36.981001 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:36.983361 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:44:36.983336 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" is forbidden: User \"system:node:ip-10-0-134-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-236.ec2.internal' and this object" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:37.062951 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.062924 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmj7q\" (UniqueName: \"kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q\") pod \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " Jul 07 17:44:37.063129 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.062979 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume\") pod \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\" (UID: \"7d4e8842-1bdf-4042-b8b6-67678029fb5c\") " Jul 07 17:44:37.063300 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.063281 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d4e8842-1bdf-4042-b8b6-67678029fb5c" (UID: "7d4e8842-1bdf-4042-b8b6-67678029fb5c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:44:37.065131 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.065109 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q" (OuterVolumeSpecName: "kube-api-access-tmj7q") pod "7d4e8842-1bdf-4042-b8b6-67678029fb5c" (UID: "7d4e8842-1bdf-4042-b8b6-67678029fb5c"). InnerVolumeSpecName "kube-api-access-tmj7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:44:37.164511 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.164444 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmj7q\" (UniqueName: \"kubernetes.io/projected/7d4e8842-1bdf-4042-b8b6-67678029fb5c-kube-api-access-tmj7q\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:44:37.164511 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.164509 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d4e8842-1bdf-4042-b8b6-67678029fb5c-extensions-socket-volume\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:44:37.754253 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.754224 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" containerID="7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d" exitCode=2 Jul 07 17:44:37.754665 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.754270 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:37.754665 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.754314 2567 scope.go:117] "RemoveContainer" containerID="7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d" Jul 07 17:44:37.756797 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:44:37.756771 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" is forbidden: User \"system:node:ip-10-0-134-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-236.ec2.internal' and this object" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:37.763380 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.763359 2567 scope.go:117] "RemoveContainer" containerID="7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d" Jul 07 17:44:37.763636 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:44:37.763621 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d\": container with ID starting with 7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d not found: ID does not exist" containerID="7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d" Jul 07 17:44:37.763691 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:37.763644 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d"} err="failed to get container status \"7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d\": rpc error: code = NotFound desc = could not find container \"7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d\": container with ID starting with 7e43dbd5a7caec64d334c5744e2a18d162c967c8420c8d06ecb9e0151b44967d not found: ID does not exist" Jul 07 17:44:37.764774 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:44:37.764747 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" is forbidden: User \"system:node:ip-10-0-134-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-236.ec2.internal' and this object" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:38.572074 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:44:38.572042 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-h5f4q\" is forbidden: User \"system:node:ip-10-0-134-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-236.ec2.internal' and this object" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h5f4q" Jul 07 17:44:38.572899 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:38.572871 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" path="/var/lib/kubelet/pods/7d4e8842-1bdf-4042-b8b6-67678029fb5c/volumes" Jul 07 17:44:47.757052 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:47.757022 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:44:48.063342 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.063310 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:44:48.063748 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.063731 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" containerName="manager" Jul 07 17:44:48.063841 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.063751 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" containerName="manager" Jul 07 17:44:48.063895 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.063846 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4e8842-1bdf-4042-b8b6-67678029fb5c" containerName="manager" Jul 07 17:44:48.068256 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.068235 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.081765 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.081745 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:44:48.173571 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.173536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbmg6\" (UniqueName: \"kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.173742 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.173601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.275119 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.275086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbmg6\" (UniqueName: \"kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.275286 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.275142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.275488 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.275444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.287285 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.287253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbmg6\" (UniqueName: \"kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvrsn\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.378942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.378865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.507024 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.506995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:44:48.511031 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:44:48.511003 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8c928b_3517_45e6_a9d0_897f6d16e014.slice/crio-1a4818fec285bf4a4d2bc3ce0f1f4e0ca3ab8743a79d3eb1dfcee2cd5df1d649 WatchSource:0}: Error finding container 1a4818fec285bf4a4d2bc3ce0f1f4e0ca3ab8743a79d3eb1dfcee2cd5df1d649: Status 404 returned error can't find the container with id 1a4818fec285bf4a4d2bc3ce0f1f4e0ca3ab8743a79d3eb1dfcee2cd5df1d649 Jul 07 17:44:48.810485 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.810433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" event={"ID":"4a8c928b-3517-45e6-a9d0-897f6d16e014","Type":"ContainerStarted","Data":"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750"} Jul 07 17:44:48.810924 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.810596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:48.810924 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.810617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" event={"ID":"4a8c928b-3517-45e6-a9d0-897f6d16e014","Type":"ContainerStarted","Data":"1a4818fec285bf4a4d2bc3ce0f1f4e0ca3ab8743a79d3eb1dfcee2cd5df1d649"} Jul 07 17:44:48.837979 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:48.837925 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" podStartSLOduration=0.837909336 podStartE2EDuration="837.909336ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:48.835893865 +0000 UTC m=+490.843126433" watchObservedRunningTime="2026-07-07 17:44:48.837909336 +0000 UTC m=+490.845141884" Jul 07 17:44:59.817603 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:59.817565 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:44:59.867311 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:59.867280 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:44:59.867539 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:44:59.867496 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" podUID="ceef8c13-6778-4f31-8b41-326d2d7488a8" containerName="manager" containerID="cri-o://1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97" gracePeriod=10 Jul 07 17:45:00.116756 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.116731 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:45:00.175420 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.175391 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf897\" (UniqueName: \"kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897\") pod \"ceef8c13-6778-4f31-8b41-326d2d7488a8\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " Jul 07 17:45:00.175585 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.175544 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume\") pod \"ceef8c13-6778-4f31-8b41-326d2d7488a8\" (UID: \"ceef8c13-6778-4f31-8b41-326d2d7488a8\") " Jul 07 17:45:00.175893 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.175869 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ceef8c13-6778-4f31-8b41-326d2d7488a8" (UID: "ceef8c13-6778-4f31-8b41-326d2d7488a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:45:00.177509 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.177482 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897" (OuterVolumeSpecName: "kube-api-access-vf897") pod "ceef8c13-6778-4f31-8b41-326d2d7488a8" (UID: "ceef8c13-6778-4f31-8b41-326d2d7488a8"). InnerVolumeSpecName "kube-api-access-vf897". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:45:00.277141 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.277108 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceef8c13-6778-4f31-8b41-326d2d7488a8-extensions-socket-volume\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:45:00.277141 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.277137 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf897\" (UniqueName: \"kubernetes.io/projected/ceef8c13-6778-4f31-8b41-326d2d7488a8-kube-api-access-vf897\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:45:00.868839 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.868745 2567 generic.go:356] "Generic (PLEG): container finished" podID="ceef8c13-6778-4f31-8b41-326d2d7488a8" containerID="1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97" exitCode=0 Jul 07 17:45:00.868839 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.868793 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" Jul 07 17:45:00.869326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.868834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" event={"ID":"ceef8c13-6778-4f31-8b41-326d2d7488a8","Type":"ContainerDied","Data":"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97"} Jul 07 17:45:00.869326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.868884 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc" event={"ID":"ceef8c13-6778-4f31-8b41-326d2d7488a8","Type":"ContainerDied","Data":"38333053d99e328e5615568424247fd86798938e53a53cdba4cf7db7bb47ac51"} Jul 07 17:45:00.869326 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.868906 2567 scope.go:117] "RemoveContainer" containerID="1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97" Jul 07 17:45:00.877610 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.877582 2567 scope.go:117] "RemoveContainer" containerID="1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97" Jul 07 17:45:00.877855 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:45:00.877834 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97\": container with ID starting with 1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97 not found: ID does not exist" containerID="1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97" Jul 07 17:45:00.877900 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.877864 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97"} err="failed to get container status \"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97\": rpc error: code = NotFound desc = could not find container \"1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97\": container with ID starting with 1849a876f32a5a7974006c2d6fe3d17a88f70a0a947261e2c21fb0822ef26e97 not found: ID does not exist" Jul 07 17:45:00.888649 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.888622 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:45:00.896689 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:00.896667 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9bngc"] Jul 07 17:45:02.571553 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:45:02.571523 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceef8c13-6778-4f31-8b41-326d2d7488a8" path="/var/lib/kubelet/pods/ceef8c13-6778-4f31-8b41-326d2d7488a8/volumes" Jul 07 17:46:25.035203 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.035171 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-77465fb5cc-cbnlm"] Jul 07 17:46:25.035643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.035544 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceef8c13-6778-4f31-8b41-326d2d7488a8" containerName="manager" Jul 07 17:46:25.035643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.035557 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceef8c13-6778-4f31-8b41-326d2d7488a8" containerName="manager" Jul 07 17:46:25.035643 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.035635 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceef8c13-6778-4f31-8b41-326d2d7488a8" containerName="manager" Jul 07 17:46:25.038813 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.038797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.039254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.039225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.039373 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.039310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7xs\" (UniqueName: \"kubernetes.io/projected/b5486aec-59df-4cbe-af0a-e9154b30ef48-kube-api-access-fm7xs\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.039468 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.039392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5486aec-59df-4cbe-af0a-e9154b30ef48-openshift-service-ca\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.041426 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.041405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 17:46:25.041549 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.041421 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ljr69\"" Jul 07 17:46:25.050798 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.050777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-77465fb5cc-cbnlm"] Jul 07 17:46:25.139974 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.139943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7xs\" (UniqueName: \"kubernetes.io/projected/b5486aec-59df-4cbe-af0a-e9154b30ef48-kube-api-access-fm7xs\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.140163 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.140006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5486aec-59df-4cbe-af0a-e9154b30ef48-openshift-service-ca\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.140163 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.140043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.140163 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:46:25.140128 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 07 17:46:25.140329 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:46:25.140190 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls podName:b5486aec-59df-4cbe-af0a-e9154b30ef48 nodeName:}" failed. No retries permitted until 2026-07-07 17:46:25.640173217 +0000 UTC m=+587.647405742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls") pod "maas-api-77465fb5cc-cbnlm" (UID: "b5486aec-59df-4cbe-af0a-e9154b30ef48") : secret "maas-api-serving-cert" not found Jul 07 17:46:25.140739 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.140712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5486aec-59df-4cbe-af0a-e9154b30ef48-openshift-service-ca\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.148650 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.148620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7xs\" (UniqueName: \"kubernetes.io/projected/b5486aec-59df-4cbe-af0a-e9154b30ef48-kube-api-access-fm7xs\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.560083 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.560051 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vfj4"] Jul 07 17:46:25.563677 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.563662 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.566282 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.566262 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 17:46:25.566282 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.566268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bvjl5\"" Jul 07 17:46:25.573334 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.573312 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vfj4"] Jul 07 17:46:25.644852 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.644819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn56h\" (UniqueName: \"kubernetes.io/projected/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-kube-api-access-qn56h\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.645003 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.644976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.645049 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.645018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.647254 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.647233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5486aec-59df-4cbe-af0a-e9154b30ef48-maas-api-tls\") pod \"maas-api-77465fb5cc-cbnlm\" (UID: \"b5486aec-59df-4cbe-af0a-e9154b30ef48\") " pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.649136 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.649116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:25.746510 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.746481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn56h\" (UniqueName: \"kubernetes.io/projected/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-kube-api-access-qn56h\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.746685 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.746582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.747577 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.747554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-plugins-config-volume\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.758547 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.758433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn56h\" (UniqueName: \"kubernetes.io/projected/a5f81df6-32b0-4588-ae2d-c90009cf4ad0-kube-api-access-qn56h\") pod \"payload-processing-58f86c7798-5vfj4\" (UID: \"a5f81df6-32b0-4588-ae2d-c90009cf4ad0\") " pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:25.786711 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.786683 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-77465fb5cc-cbnlm"] Jul 07 17:46:25.790329 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:46:25.790302 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5486aec_59df_4cbe_af0a_e9154b30ef48.slice/crio-0d1f46b017d3ac5c16374a9e7198fe34b5a1970ec99c724e9c9fb47fbe5905ad WatchSource:0}: Error finding container 0d1f46b017d3ac5c16374a9e7198fe34b5a1970ec99c724e9c9fb47fbe5905ad: Status 404 returned error can't find the container with id 0d1f46b017d3ac5c16374a9e7198fe34b5a1970ec99c724e9c9fb47fbe5905ad Jul 07 17:46:25.876203 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:25.876133 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:26.005473 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:26.005435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5vfj4"] Jul 07 17:46:26.007589 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:46:26.007565 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f81df6_32b0_4588_ae2d_c90009cf4ad0.slice/crio-7689e4269a45c050ebdb49a159114a5ae875787f3df7f8f54b0f2b2f419a7e5a WatchSource:0}: Error finding container 7689e4269a45c050ebdb49a159114a5ae875787f3df7f8f54b0f2b2f419a7e5a: Status 404 returned error can't find the container with id 7689e4269a45c050ebdb49a159114a5ae875787f3df7f8f54b0f2b2f419a7e5a Jul 07 17:46:26.278195 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:26.278160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" event={"ID":"a5f81df6-32b0-4588-ae2d-c90009cf4ad0","Type":"ContainerStarted","Data":"7689e4269a45c050ebdb49a159114a5ae875787f3df7f8f54b0f2b2f419a7e5a"} Jul 07 17:46:26.279351 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:26.279329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-77465fb5cc-cbnlm" event={"ID":"b5486aec-59df-4cbe-af0a-e9154b30ef48","Type":"ContainerStarted","Data":"0d1f46b017d3ac5c16374a9e7198fe34b5a1970ec99c724e9c9fb47fbe5905ad"} Jul 07 17:46:28.290639 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.290603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" event={"ID":"a5f81df6-32b0-4588-ae2d-c90009cf4ad0","Type":"ContainerStarted","Data":"b7fc1803ca900ecce5b2c508a4c8beaf1b4ab2de4da4dcf9bc5ed7233819eceb"} Jul 07 17:46:28.291103 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.290792 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:46:28.292082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.292061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-77465fb5cc-cbnlm" event={"ID":"b5486aec-59df-4cbe-af0a-e9154b30ef48","Type":"ContainerStarted","Data":"226279e30067890a607da52aee90eb379ab26badab34aa20c4e0ada41c39771b"} Jul 07 17:46:28.292185 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.292174 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:28.307240 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.307201 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" podStartSLOduration=1.506835804 podStartE2EDuration="3.307187109s" totalImagesPullingTime="1.800351305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:46:28.30530474 +0000 UTC m=+590.312537289" watchObservedRunningTime="2026-07-07 17:46:28.307187109 +0000 UTC m=+590.314419657" Jul 07 17:46:28.324063 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:28.324017 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-77465fb5cc-cbnlm" podStartSLOduration=1.3048830439999999 podStartE2EDuration="3.324003401s" totalImagesPullingTime="2.019120357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:46:28.322099592 +0000 UTC m=+590.329332144" watchObservedRunningTime="2026-07-07 17:46:28.324003401 +0000 UTC m=+590.331235948" Jul 07 17:46:34.301965 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:34.301939 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-77465fb5cc-cbnlm" Jul 07 17:46:38.421165 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:38.421137 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:46:38.421632 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:38.421552 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:46:39.298359 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:46:39.298332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-5vfj4" Jul 07 17:47:20.654678 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.654644 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg"] Jul 07 17:47:20.656985 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.656965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.659494 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.659470 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 17:47:20.659661 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.659641 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 17:47:20.659758 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.659675 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 17:47:20.660787 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.660770 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lvk68\"" Jul 07 17:47:20.666845 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.666822 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg"] Jul 07 17:47:20.749275 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.749437 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.749437 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.749533 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.749578 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpsj\" (UniqueName: \"kubernetes.io/projected/371798ca-da40-494e-a6ad-58b31ff05fbf-kube-api-access-hdpsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.749638 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.749621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/371798ca-da40-494e-a6ad-58b31ff05fbf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850763 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/371798ca-da40-494e-a6ad-58b31ff05fbf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.850938 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.850886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpsj\" (UniqueName: \"kubernetes.io/projected/371798ca-da40-494e-a6ad-58b31ff05fbf-kube-api-access-hdpsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.851310 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.851278 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.851509 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.851323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.851509 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.851376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.853223 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.853203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/371798ca-da40-494e-a6ad-58b31ff05fbf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.853358 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.853343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/371798ca-da40-494e-a6ad-58b31ff05fbf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.858095 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.858071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpsj\" (UniqueName: \"kubernetes.io/projected/371798ca-da40-494e-a6ad-58b31ff05fbf-kube-api-access-hdpsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg\" (UID: \"371798ca-da40-494e-a6ad-58b31ff05fbf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:20.969825 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:20.969745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:21.098130 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:21.098102 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg"] Jul 07 17:47:21.100371 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:47:21.100347 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371798ca_da40_494e_a6ad_58b31ff05fbf.slice/crio-ead21bfc0e9f79db4aa2a4699668035873f7fe96084c8b17e5f35b3bdf8059bc WatchSource:0}: Error finding container ead21bfc0e9f79db4aa2a4699668035873f7fe96084c8b17e5f35b3bdf8059bc: Status 404 returned error can't find the container with id ead21bfc0e9f79db4aa2a4699668035873f7fe96084c8b17e5f35b3bdf8059bc Jul 07 17:47:21.102082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:21.102067 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:47:21.555196 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:21.555160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" event={"ID":"371798ca-da40-494e-a6ad-58b31ff05fbf","Type":"ContainerStarted","Data":"ead21bfc0e9f79db4aa2a4699668035873f7fe96084c8b17e5f35b3bdf8059bc"} Jul 07 17:47:22.563306 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:22.563267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" event={"ID":"371798ca-da40-494e-a6ad-58b31ff05fbf","Type":"ContainerStarted","Data":"afe2c0735a5c81918b53631028d94a72f3d0e65cd7096286eaef3823a85e476a"} Jul 07 17:47:22.582309 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:22.582264 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" podStartSLOduration=1.562355833 podStartE2EDuration="2.582248667s" totalImagesPullingTime="1.019892834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:22.581763367 +0000 UTC m=+644.588995917" watchObservedRunningTime="2026-07-07 17:47:22.582248667 +0000 UTC m=+644.589481215" Jul 07 17:47:25.457320 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.457281 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn"] Jul 07 17:47:25.459867 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.459852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.462273 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.462252 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 17:47:25.471959 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.471937 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn"] Jul 07 17:47:25.599192 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.599192 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205be9ae-2fb9-4580-a040-06436c41fe8e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.599413 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/205be9ae-2fb9-4580-a040-06436c41fe8e-kube-api-access-rxqsl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.599413 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.599413 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.599536 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.599419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.700841 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205be9ae-2fb9-4580-a040-06436c41fe8e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.700951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/205be9ae-2fb9-4580-a040-06436c41fe8e-kube-api-access-rxqsl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701290 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.701254 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701348 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.701306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.701348 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.701328 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.703209 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.703183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205be9ae-2fb9-4580-a040-06436c41fe8e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.703500 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.703482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205be9ae-2fb9-4580-a040-06436c41fe8e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.708526 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.708477 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/205be9ae-2fb9-4580-a040-06436c41fe8e-kube-api-access-rxqsl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cj8zn\" (UID: \"205be9ae-2fb9-4580-a040-06436c41fe8e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.770589 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.770560 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:25.904274 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:25.904244 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn"] Jul 07 17:47:25.906151 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:47:25.906124 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205be9ae_2fb9_4580_a040_06436c41fe8e.slice/crio-8d850ae3ef2a785c05221216efe0e2c0d7a039d956d93b1ac44b18ded653e5ea WatchSource:0}: Error finding container 8d850ae3ef2a785c05221216efe0e2c0d7a039d956d93b1ac44b18ded653e5ea: Status 404 returned error can't find the container with id 8d850ae3ef2a785c05221216efe0e2c0d7a039d956d93b1ac44b18ded653e5ea Jul 07 17:47:26.585359 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:26.585321 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" event={"ID":"205be9ae-2fb9-4580-a040-06436c41fe8e","Type":"ContainerStarted","Data":"e38f7b251490ed8a129613798ef12c5b1875bf6066bfffd5c3c255e9e16abf34"} Jul 07 17:47:26.585753 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:26.585370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" event={"ID":"205be9ae-2fb9-4580-a040-06436c41fe8e","Type":"ContainerStarted","Data":"8d850ae3ef2a785c05221216efe0e2c0d7a039d956d93b1ac44b18ded653e5ea"} Jul 07 17:47:26.608340 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:26.608288 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" podStartSLOduration=1.3677990150000001 podStartE2EDuration="1.608272618s" totalImagesPullingTime="240.473603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:26.60633521 +0000 UTC m=+648.613567773" watchObservedRunningTime="2026-07-07 17:47:26.608272618 +0000 UTC m=+648.615505166" Jul 07 17:47:30.970907 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:30.970852 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:30.971324 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:30.970935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:30.983650 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:30.983619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:31.619671 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:31.619646 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg" Jul 07 17:47:35.771027 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:35.770991 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:35.771554 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:35.771061 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:35.783625 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:35.783604 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:47:36.643599 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:47:36.643567 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cj8zn" Jul 07 17:49:52.825929 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.825895 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858949756f-g72tb"] Jul 07 17:49:52.829941 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.829919 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.832959 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.832936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 17:49:52.832959 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.832955 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 17:49:52.834422 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834397 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 17:49:52.834545 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834499 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 17:49:52.834593 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834568 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6gcg\"" Jul 07 17:49:52.834637 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834619 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 17:49:52.834703 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834690 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 17:49:52.834849 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.834836 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 17:49:52.840071 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.840044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 17:49:52.841275 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.841254 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858949756f-g72tb"] Jul 07 17:49:52.874720 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.874689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.874720 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.874720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.874942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.874810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-service-ca\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.874942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.874884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-trusted-ca-bundle\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.874942 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.874919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-oauth-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.875089 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.875009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57k89\" (UniqueName: \"kubernetes.io/projected/3be7a5a0-abc1-4c36-a6df-653439e25c8d-kube-api-access-57k89\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.875089 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.875064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-oauth-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975590 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975590 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-service-ca\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-trusted-ca-bundle\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-oauth-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57k89\" (UniqueName: \"kubernetes.io/projected/3be7a5a0-abc1-4c36-a6df-653439e25c8d-kube-api-access-57k89\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.975820 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.975753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-oauth-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.976513 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.976483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-service-ca\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.976653 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.976484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.976653 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.976575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-oauth-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.976653 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.976629 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3be7a5a0-abc1-4c36-a6df-653439e25c8d-trusted-ca-bundle\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.978129 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.978106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-oauth-config\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.978294 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.978275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3be7a5a0-abc1-4c36-a6df-653439e25c8d-console-serving-cert\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:52.983178 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:52.983159 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57k89\" (UniqueName: \"kubernetes.io/projected/3be7a5a0-abc1-4c36-a6df-653439e25c8d-kube-api-access-57k89\") pod \"console-858949756f-g72tb\" (UID: \"3be7a5a0-abc1-4c36-a6df-653439e25c8d\") " pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:53.141797 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:53.141715 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:49:53.278082 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:53.278050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858949756f-g72tb"] Jul 07 17:49:53.281680 ip-10-0-134-236 kubenswrapper[2567]: W0707 17:49:53.281654 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be7a5a0_abc1_4c36_a6df_653439e25c8d.slice/crio-566235a2452b56862a6b83f0c2d7b28ed0e422cc43e7b1e93aaab5efa596ed94 WatchSource:0}: Error finding container 566235a2452b56862a6b83f0c2d7b28ed0e422cc43e7b1e93aaab5efa596ed94: Status 404 returned error can't find the container with id 566235a2452b56862a6b83f0c2d7b28ed0e422cc43e7b1e93aaab5efa596ed94 Jul 07 17:49:53.303420 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:53.303395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858949756f-g72tb" event={"ID":"3be7a5a0-abc1-4c36-a6df-653439e25c8d","Type":"ContainerStarted","Data":"566235a2452b56862a6b83f0c2d7b28ed0e422cc43e7b1e93aaab5efa596ed94"} Jul 07 17:49:54.309690 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:54.309648 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858949756f-g72tb" event={"ID":"3be7a5a0-abc1-4c36-a6df-653439e25c8d","Type":"ContainerStarted","Data":"917714dd47260bda4938a080c3736ba430529cc1a460cd1cfb273dd1d718edcf"} Jul 07 17:49:54.325966 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:49:54.325916 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858949756f-g72tb" podStartSLOduration=2.325897744 podStartE2EDuration="2.325897744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:54.32580393 +0000 UTC m=+796.333036483" watchObservedRunningTime="2026-07-07 17:49:54.325897744 +0000 UTC m=+796.333130293" Jul 07 17:50:03.142894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:50:03.142800 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:50:03.142894 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:50:03.142885 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:50:03.147771 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:50:03.147750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:50:03.361172 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:50:03.361143 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858949756f-g72tb" Jul 07 17:51:38.453639 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:51:38.453547 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:51:38.454563 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:51:38.454516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:54:42.700278 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:42.700186 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:54:42.700837 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:42.700440 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" podUID="4a8c928b-3517-45e6-a9d0-897f6d16e014" containerName="manager" containerID="cri-o://8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750" gracePeriod=10 Jul 07 17:54:44.959451 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:44.959422 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:54:45.051511 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.051487 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbmg6\" (UniqueName: \"kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6\") pod \"4a8c928b-3517-45e6-a9d0-897f6d16e014\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " Jul 07 17:54:45.051660 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.051569 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume\") pod \"4a8c928b-3517-45e6-a9d0-897f6d16e014\" (UID: \"4a8c928b-3517-45e6-a9d0-897f6d16e014\") " Jul 07 17:54:45.051961 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.051940 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4a8c928b-3517-45e6-a9d0-897f6d16e014" (UID: "4a8c928b-3517-45e6-a9d0-897f6d16e014"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:54:45.053580 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.053557 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6" (OuterVolumeSpecName: "kube-api-access-fbmg6") pod "4a8c928b-3517-45e6-a9d0-897f6d16e014" (UID: "4a8c928b-3517-45e6-a9d0-897f6d16e014"). InnerVolumeSpecName "kube-api-access-fbmg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:54:45.152983 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.152945 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbmg6\" (UniqueName: \"kubernetes.io/projected/4a8c928b-3517-45e6-a9d0-897f6d16e014-kube-api-access-fbmg6\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:54:45.152983 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.152977 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a8c928b-3517-45e6-a9d0-897f6d16e014-extensions-socket-volume\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 17:54:45.791346 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.791315 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a8c928b-3517-45e6-a9d0-897f6d16e014" containerID="8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750" exitCode=0 Jul 07 17:54:45.791556 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.791356 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" Jul 07 17:54:45.791556 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.791408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" event={"ID":"4a8c928b-3517-45e6-a9d0-897f6d16e014","Type":"ContainerDied","Data":"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750"} Jul 07 17:54:45.791556 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.791482 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn" event={"ID":"4a8c928b-3517-45e6-a9d0-897f6d16e014","Type":"ContainerDied","Data":"1a4818fec285bf4a4d2bc3ce0f1f4e0ca3ab8743a79d3eb1dfcee2cd5df1d649"} Jul 07 17:54:45.791556 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.791514 2567 scope.go:117] "RemoveContainer" containerID="8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750" Jul 07 17:54:45.801181 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.801165 2567 scope.go:117] "RemoveContainer" containerID="8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750" Jul 07 17:54:45.801467 ip-10-0-134-236 kubenswrapper[2567]: E0707 17:54:45.801437 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750\": container with ID starting with 8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750 not found: ID does not exist" containerID="8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750" Jul 07 17:54:45.801573 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.801554 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750"} err="failed to get container status \"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750\": rpc error: code = NotFound desc = could not find container \"8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750\": container with ID starting with 8759a7c289d2c78359708af7d0625c1ebff6193def779fa2e7aca4f5a18a0750 not found: ID does not exist" Jul 07 17:54:45.813410 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.813391 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:54:45.818833 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:45.818813 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvrsn"] Jul 07 17:54:46.572479 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:54:46.572432 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a8c928b-3517-45e6-a9d0-897f6d16e014" path="/var/lib/kubelet/pods/4a8c928b-3517-45e6-a9d0-897f6d16e014/volumes" Jul 07 17:56:38.484436 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:56:38.484407 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 17:56:38.486521 ip-10-0-134-236 kubenswrapper[2567]: I0707 17:56:38.486496 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:00:00.151214 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.151179 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-lhc2j"] Jul 07 18:00:00.153805 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.151737 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8c928b-3517-45e6-a9d0-897f6d16e014" containerName="manager" Jul 07 18:00:00.153805 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.151752 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8c928b-3517-45e6-a9d0-897f6d16e014" containerName="manager" Jul 07 18:00:00.153805 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.151818 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a8c928b-3517-45e6-a9d0-897f6d16e014" containerName="manager" Jul 07 18:00:00.154857 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.154839 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:00.168824 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.168801 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-lhc2j"] Jul 07 18:00:00.306741 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.306713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj5wd\" (UniqueName: \"kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd\") pod \"maas-api-key-cleanup-29724120-lhc2j\" (UID: \"10976261-a6fa-4196-a85c-0d3d44202bf7\") " pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:00.407651 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.407574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj5wd\" (UniqueName: \"kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd\") pod \"maas-api-key-cleanup-29724120-lhc2j\" (UID: \"10976261-a6fa-4196-a85c-0d3d44202bf7\") " pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:00.415852 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.415827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj5wd\" (UniqueName: \"kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd\") pod \"maas-api-key-cleanup-29724120-lhc2j\" (UID: \"10976261-a6fa-4196-a85c-0d3d44202bf7\") " pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:00.464538 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.464518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:00.594265 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.594243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-lhc2j"] Jul 07 18:00:00.596255 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:00:00.596232 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10976261_a6fa_4196_a85c_0d3d44202bf7.slice/crio-8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe WatchSource:0}: Error finding container 8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe: Status 404 returned error can't find the container with id 8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe Jul 07 18:00:00.598100 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:00.598084 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:00:01.304583 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:01.304551 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" event={"ID":"10976261-a6fa-4196-a85c-0d3d44202bf7","Type":"ContainerStarted","Data":"8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe"} Jul 07 18:00:06.330810 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:06.330777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" event={"ID":"10976261-a6fa-4196-a85c-0d3d44202bf7","Type":"ContainerStarted","Data":"f89f20b46988e56aeb6b66ddd87e6c9cb288cbe98c2e89404df8d7b1acc8e86a"} Jul 07 18:00:06.351709 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:06.351666 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" podStartSLOduration=0.948433088 podStartE2EDuration="6.35165088s" totalImagesPullingTime="5.403217792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:00:06.349537437 +0000 UTC m=+1408.356770010" watchObservedRunningTime="2026-07-07 18:00:06.35165088 +0000 UTC m=+1408.358883428" Jul 07 18:00:07.337313 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:07.337275 2567 generic.go:356] "Generic (PLEG): container finished" podID="10976261-a6fa-4196-a85c-0d3d44202bf7" containerID="f89f20b46988e56aeb6b66ddd87e6c9cb288cbe98c2e89404df8d7b1acc8e86a" exitCode=0 Jul 07 18:00:07.337724 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:07.337364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" event={"ID":"10976261-a6fa-4196-a85c-0d3d44202bf7","Type":"ContainerDied","Data":"f89f20b46988e56aeb6b66ddd87e6c9cb288cbe98c2e89404df8d7b1acc8e86a"} Jul 07 18:00:08.471292 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:08.471265 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:08.577334 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:08.577305 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj5wd\" (UniqueName: \"kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd\") pod \"10976261-a6fa-4196-a85c-0d3d44202bf7\" (UID: \"10976261-a6fa-4196-a85c-0d3d44202bf7\") " Jul 07 18:00:08.579536 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:08.579509 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd" (OuterVolumeSpecName: "kube-api-access-mj5wd") pod "10976261-a6fa-4196-a85c-0d3d44202bf7" (UID: "10976261-a6fa-4196-a85c-0d3d44202bf7"). InnerVolumeSpecName "kube-api-access-mj5wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:00:08.678268 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:08.678210 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj5wd\" (UniqueName: \"kubernetes.io/projected/10976261-a6fa-4196-a85c-0d3d44202bf7-kube-api-access-mj5wd\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:00:09.347170 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:09.347137 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" event={"ID":"10976261-a6fa-4196-a85c-0d3d44202bf7","Type":"ContainerDied","Data":"8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe"} Jul 07 18:00:09.347170 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:09.347158 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-lhc2j" Jul 07 18:00:09.347380 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:00:09.347193 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8875003956d9ce3042847b798f653bfa320986edc3dae9bb25cf275c35e353fe" Jul 07 18:01:38.515895 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:01:38.515866 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:01:38.517651 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:01:38.517627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:02:02.772548 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.772513 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:02.773119 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.773097 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10976261-a6fa-4196-a85c-0d3d44202bf7" containerName="cleanup" Jul 07 18:02:02.773185 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.773123 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="10976261-a6fa-4196-a85c-0d3d44202bf7" containerName="cleanup" Jul 07 18:02:02.773271 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.773257 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="10976261-a6fa-4196-a85c-0d3d44202bf7" containerName="cleanup" Jul 07 18:02:02.775839 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.775817 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:02.778481 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.778440 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-494e9685-serving-cert\"" Jul 07 18:02:02.789417 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.789395 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:02.903706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.903666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:02.903706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.903719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4bc5\" (UniqueName: \"kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:02.903919 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:02.903798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.004659 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.004613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.004659 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.004662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4bc5\" (UniqueName: \"kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.004864 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.004725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.005422 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.005389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.007051 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.007028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.013045 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.013019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4bc5\" (UniqueName: \"kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5\") pod \"maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.086594 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.086559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.224625 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.224601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:03.226649 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:02:03.226611 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09ef123_edb9_4e8d_8235_b3adf16b5beb.slice/crio-2a9b6637284c85a65f5ce34fe35ddb956e3f127f19943fa2e60863a3d4193c13 WatchSource:0}: Error finding container 2a9b6637284c85a65f5ce34fe35ddb956e3f127f19943fa2e60863a3d4193c13: Status 404 returned error can't find the container with id 2a9b6637284c85a65f5ce34fe35ddb956e3f127f19943fa2e60863a3d4193c13 Jul 07 18:02:03.904648 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.904615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" event={"ID":"d09ef123-edb9-4e8d-8235-b3adf16b5beb","Type":"ContainerStarted","Data":"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d"} Jul 07 18:02:03.905018 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.904667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" event={"ID":"d09ef123-edb9-4e8d-8235-b3adf16b5beb","Type":"ContainerStarted","Data":"2a9b6637284c85a65f5ce34fe35ddb956e3f127f19943fa2e60863a3d4193c13"} Jul 07 18:02:03.905018 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.904693 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:03.922062 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:03.922013 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" podStartSLOduration=1.390688847 podStartE2EDuration="1.921999484s" totalImagesPullingTime="531.310637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:03.920662155 +0000 UTC m=+1525.927894707" watchObservedRunningTime="2026-07-07 18:02:03.921999484 +0000 UTC m=+1525.929232032" Jul 07 18:02:08.023524 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.023487 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:08.023995 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.023722 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" podUID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" containerName="maas-api" containerID="cri-o://c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d" gracePeriod=30 Jul 07 18:02:08.030767 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.030741 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:08.272229 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.272205 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:08.354014 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.353989 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4bc5\" (UniqueName: \"kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5\") pod \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " Jul 07 18:02:08.354192 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.354041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca\") pod \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " Jul 07 18:02:08.354192 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.354123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls\") pod \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\" (UID: \"d09ef123-edb9-4e8d-8235-b3adf16b5beb\") " Jul 07 18:02:08.354494 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.354467 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d09ef123-edb9-4e8d-8235-b3adf16b5beb" (UID: "d09ef123-edb9-4e8d-8235-b3adf16b5beb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:08.356148 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.356121 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5" (OuterVolumeSpecName: "kube-api-access-x4bc5") pod "d09ef123-edb9-4e8d-8235-b3adf16b5beb" (UID: "d09ef123-edb9-4e8d-8235-b3adf16b5beb"). InnerVolumeSpecName "kube-api-access-x4bc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:08.356276 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.356259 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d09ef123-edb9-4e8d-8235-b3adf16b5beb" (UID: "d09ef123-edb9-4e8d-8235-b3adf16b5beb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:02:08.455535 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.455503 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d09ef123-edb9-4e8d-8235-b3adf16b5beb-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:08.455535 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.455527 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4bc5\" (UniqueName: \"kubernetes.io/projected/d09ef123-edb9-4e8d-8235-b3adf16b5beb-kube-api-access-x4bc5\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:08.455535 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.455538 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d09ef123-edb9-4e8d-8235-b3adf16b5beb-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:08.930198 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.930164 2567 generic.go:356] "Generic (PLEG): container finished" podID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" containerID="c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d" exitCode=0 Jul 07 18:02:08.930380 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.930211 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" Jul 07 18:02:08.930380 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.930223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" event={"ID":"d09ef123-edb9-4e8d-8235-b3adf16b5beb","Type":"ContainerDied","Data":"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d"} Jul 07 18:02:08.930380 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.930266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh" event={"ID":"d09ef123-edb9-4e8d-8235-b3adf16b5beb","Type":"ContainerDied","Data":"2a9b6637284c85a65f5ce34fe35ddb956e3f127f19943fa2e60863a3d4193c13"} Jul 07 18:02:08.930380 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.930286 2567 scope.go:117] "RemoveContainer" containerID="c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d" Jul 07 18:02:08.939071 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.939048 2567 scope.go:117] "RemoveContainer" containerID="c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d" Jul 07 18:02:08.939336 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:02:08.939317 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d\": container with ID starting with c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d not found: ID does not exist" containerID="c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d" Jul 07 18:02:08.939403 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.939343 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d"} err="failed to get container status \"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d\": rpc error: code = NotFound desc = could not find container \"c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d\": container with ID starting with c4141075880f5b3fbbba8a8d1b42dfc64ec16f11621c44a00cd4e192eb7ad36d not found: ID does not exist" Jul 07 18:02:08.946842 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.946822 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:08.948677 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:08.948655 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-494e9685-6b8d6bc8d-9zjfh"] Jul 07 18:02:10.572755 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:10.572723 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" path="/var/lib/kubelet/pods/d09ef123-edb9-4e8d-8235-b3adf16b5beb/volumes" Jul 07 18:02:15.035601 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.035564 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:15.036129 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.036111 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" containerName="maas-api" Jul 07 18:02:15.036206 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.036134 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" containerName="maas-api" Jul 07 18:02:15.036260 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.036246 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d09ef123-edb9-4e8d-8235-b3adf16b5beb" containerName="maas-api" Jul 07 18:02:15.039156 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.039134 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.041669 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.041642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-b78dfc41-serving-cert\"" Jul 07 18:02:15.049315 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.049291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:15.122602 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.122570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.122749 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.122614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v24c7\" (UniqueName: \"kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.122749 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.122659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.223973 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.223933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.223973 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.223977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v24c7\" (UniqueName: \"kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.224184 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.224012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.224184 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:02:15.224122 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-b78dfc41-serving-cert: secret "maas-api-e2e-ait-b78dfc41-serving-cert" not found Jul 07 18:02:15.224254 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:02:15.224208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls podName:96adbc62-b5eb-487a-b493-559d85c9d4c5 nodeName:}" failed. No retries permitted until 2026-07-07 18:02:15.724188422 +0000 UTC m=+1537.731420952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls") pod "maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" (UID: "96adbc62-b5eb-487a-b493-559d85c9d4c5") : secret "maas-api-e2e-ait-b78dfc41-serving-cert" not found Jul 07 18:02:15.224575 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.224558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.235984 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.235952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v24c7\" (UniqueName: \"kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.729242 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.729202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.731777 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.731752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") pod \"maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:15.952547 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:15.952510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:16.088844 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:16.088820 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:16.090876 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:02:16.090848 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96adbc62_b5eb_487a_b493_559d85c9d4c5.slice/crio-69fcb9f6ec7596a001f2af30ebb8b674ec39d1cf725712424791f91d7a4622ec WatchSource:0}: Error finding container 69fcb9f6ec7596a001f2af30ebb8b674ec39d1cf725712424791f91d7a4622ec: Status 404 returned error can't find the container with id 69fcb9f6ec7596a001f2af30ebb8b674ec39d1cf725712424791f91d7a4622ec Jul 07 18:02:16.970956 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:16.970921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" event={"ID":"96adbc62-b5eb-487a-b493-559d85c9d4c5","Type":"ContainerStarted","Data":"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f"} Jul 07 18:02:16.971118 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:16.970972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" event={"ID":"96adbc62-b5eb-487a-b493-559d85c9d4c5","Type":"ContainerStarted","Data":"69fcb9f6ec7596a001f2af30ebb8b674ec39d1cf725712424791f91d7a4622ec"} Jul 07 18:02:16.971118 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:16.971002 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:16.989001 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:16.988956 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" podStartSLOduration=1.590593358 podStartE2EDuration="1.988942837s" totalImagesPullingTime="398.349479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:16.987554756 +0000 UTC m=+1538.994787333" watchObservedRunningTime="2026-07-07 18:02:16.988942837 +0000 UTC m=+1538.996175385" Jul 07 18:02:20.498292 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.498258 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:20.498787 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.498511 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" podUID="96adbc62-b5eb-487a-b493-559d85c9d4c5" containerName="maas-api" containerID="cri-o://a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f" gracePeriod=30 Jul 07 18:02:20.747688 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.747666 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:20.875739 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.875699 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v24c7\" (UniqueName: \"kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7\") pod \"96adbc62-b5eb-487a-b493-559d85c9d4c5\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " Jul 07 18:02:20.875947 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.875829 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") pod \"96adbc62-b5eb-487a-b493-559d85c9d4c5\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " Jul 07 18:02:20.875947 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.875878 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca\") pod \"96adbc62-b5eb-487a-b493-559d85c9d4c5\" (UID: \"96adbc62-b5eb-487a-b493-559d85c9d4c5\") " Jul 07 18:02:20.876253 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.876227 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96adbc62-b5eb-487a-b493-559d85c9d4c5" (UID: "96adbc62-b5eb-487a-b493-559d85c9d4c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:20.877824 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.877797 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96adbc62-b5eb-487a-b493-559d85c9d4c5" (UID: "96adbc62-b5eb-487a-b493-559d85c9d4c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:02:20.877824 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.877816 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7" (OuterVolumeSpecName: "kube-api-access-v24c7") pod "96adbc62-b5eb-487a-b493-559d85c9d4c5" (UID: "96adbc62-b5eb-487a-b493-559d85c9d4c5"). InnerVolumeSpecName "kube-api-access-v24c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:20.976821 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.976788 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96adbc62-b5eb-487a-b493-559d85c9d4c5-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:20.976821 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.976816 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96adbc62-b5eb-487a-b493-559d85c9d4c5-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:20.976821 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.976827 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v24c7\" (UniqueName: \"kubernetes.io/projected/96adbc62-b5eb-487a-b493-559d85c9d4c5-kube-api-access-v24c7\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:20.991691 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.991659 2567 generic.go:356] "Generic (PLEG): container finished" podID="96adbc62-b5eb-487a-b493-559d85c9d4c5" containerID="a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f" exitCode=0 Jul 07 18:02:20.991691 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.991696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" event={"ID":"96adbc62-b5eb-487a-b493-559d85c9d4c5","Type":"ContainerDied","Data":"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f"} Jul 07 18:02:20.991933 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.991710 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" Jul 07 18:02:20.991933 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.991737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw" event={"ID":"96adbc62-b5eb-487a-b493-559d85c9d4c5","Type":"ContainerDied","Data":"69fcb9f6ec7596a001f2af30ebb8b674ec39d1cf725712424791f91d7a4622ec"} Jul 07 18:02:20.991933 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:20.991757 2567 scope.go:117] "RemoveContainer" containerID="a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f" Jul 07 18:02:21.001690 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:21.001674 2567 scope.go:117] "RemoveContainer" containerID="a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f" Jul 07 18:02:21.001960 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:02:21.001937 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f\": container with ID starting with a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f not found: ID does not exist" containerID="a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f" Jul 07 18:02:21.002027 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:21.001976 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f"} err="failed to get container status \"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f\": rpc error: code = NotFound desc = could not find container \"a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f\": container with ID starting with a1e63445c9547a1b3928476fb418c5c1ad0c242c89ecdfbce7cc2aa23f2bfd3f not found: ID does not exist" Jul 07 18:02:21.014116 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:21.014092 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:21.017077 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:21.017056 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-b78dfc41-f8ddf57-mphkw"] Jul 07 18:02:22.572053 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:22.572021 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96adbc62-b5eb-487a-b493-559d85c9d4c5" path="/var/lib/kubelet/pods/96adbc62-b5eb-487a-b493-559d85c9d4c5/volumes" Jul 07 18:02:33.615224 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.615188 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:33.615803 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.615786 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96adbc62-b5eb-487a-b493-559d85c9d4c5" containerName="maas-api" Jul 07 18:02:33.615846 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.615806 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="96adbc62-b5eb-487a-b493-559d85c9d4c5" containerName="maas-api" Jul 07 18:02:33.615910 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.615898 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="96adbc62-b5eb-487a-b493-559d85c9d4c5" containerName="maas-api" Jul 07 18:02:33.619079 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.619059 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.622184 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.622159 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-237040df-serving-cert\"" Jul 07 18:02:33.628075 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.628054 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:33.705765 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.705732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5x6l\" (UniqueName: \"kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.705927 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.705798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.706003 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.705978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.806625 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.806590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.806827 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.806637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5x6l\" (UniqueName: \"kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.806827 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.806678 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.807351 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.807323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.809084 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.809064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.825113 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.825087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5x6l\" (UniqueName: \"kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l\") pod \"maas-api-e2e-derive-237040df-759cc5f589-mrw8v\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:33.931623 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:33.931520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:34.062332 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:34.062308 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:34.064897 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:02:34.064874 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b39e10c_1cd7_446b_b46e_cd5086ccb76b.slice/crio-922ba51abe1520147fa1449bc22fe7b1e773b7aa6d866550dedff5cf8450f523 WatchSource:0}: Error finding container 922ba51abe1520147fa1449bc22fe7b1e773b7aa6d866550dedff5cf8450f523: Status 404 returned error can't find the container with id 922ba51abe1520147fa1449bc22fe7b1e773b7aa6d866550dedff5cf8450f523 Jul 07 18:02:35.064941 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:35.064902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" event={"ID":"9b39e10c-1cd7-446b-b46e-cd5086ccb76b","Type":"ContainerStarted","Data":"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066"} Jul 07 18:02:35.065431 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:35.064960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" event={"ID":"9b39e10c-1cd7-446b-b46e-cd5086ccb76b","Type":"ContainerStarted","Data":"922ba51abe1520147fa1449bc22fe7b1e773b7aa6d866550dedff5cf8450f523"} Jul 07 18:02:35.065431 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:35.064999 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:35.082731 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:35.082677 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" podStartSLOduration=1.737266101 podStartE2EDuration="2.082661123s" totalImagesPullingTime="345.395022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:35.080764157 +0000 UTC m=+1557.087996698" watchObservedRunningTime="2026-07-07 18:02:35.082661123 +0000 UTC m=+1557.089893672" Jul 07 18:02:38.311828 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.306549 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:38.311828 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.306888 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" podUID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" containerName="maas-api" containerID="cri-o://4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066" gracePeriod=30 Jul 07 18:02:38.569084 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.569062 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:38.651716 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.651687 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls\") pod \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " Jul 07 18:02:38.651899 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.651727 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca\") pod \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " Jul 07 18:02:38.651899 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.651840 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5x6l\" (UniqueName: \"kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l\") pod \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\" (UID: \"9b39e10c-1cd7-446b-b46e-cd5086ccb76b\") " Jul 07 18:02:38.652122 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.652100 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b39e10c-1cd7-446b-b46e-cd5086ccb76b" (UID: "9b39e10c-1cd7-446b-b46e-cd5086ccb76b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:38.652228 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.652213 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:38.653865 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.653831 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l" (OuterVolumeSpecName: "kube-api-access-v5x6l") pod "9b39e10c-1cd7-446b-b46e-cd5086ccb76b" (UID: "9b39e10c-1cd7-446b-b46e-cd5086ccb76b"). InnerVolumeSpecName "kube-api-access-v5x6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:38.653865 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.653853 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b39e10c-1cd7-446b-b46e-cd5086ccb76b" (UID: "9b39e10c-1cd7-446b-b46e-cd5086ccb76b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:02:38.753543 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.753517 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:38.753543 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:38.753541 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5x6l\" (UniqueName: \"kubernetes.io/projected/9b39e10c-1cd7-446b-b46e-cd5086ccb76b-kube-api-access-v5x6l\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:02:39.085192 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.085153 2567 generic.go:356] "Generic (PLEG): container finished" podID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" containerID="4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066" exitCode=0 Jul 07 18:02:39.085378 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.085208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" event={"ID":"9b39e10c-1cd7-446b-b46e-cd5086ccb76b","Type":"ContainerDied","Data":"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066"} Jul 07 18:02:39.085378 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.085230 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" Jul 07 18:02:39.085378 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.085274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v" event={"ID":"9b39e10c-1cd7-446b-b46e-cd5086ccb76b","Type":"ContainerDied","Data":"922ba51abe1520147fa1449bc22fe7b1e773b7aa6d866550dedff5cf8450f523"} Jul 07 18:02:39.085378 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.085307 2567 scope.go:117] "RemoveContainer" containerID="4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066" Jul 07 18:02:39.094977 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.094961 2567 scope.go:117] "RemoveContainer" containerID="4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066" Jul 07 18:02:39.095223 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:02:39.095204 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066\": container with ID starting with 4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066 not found: ID does not exist" containerID="4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066" Jul 07 18:02:39.095257 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.095232 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066"} err="failed to get container status \"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066\": rpc error: code = NotFound desc = could not find container \"4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066\": container with ID starting with 4eefd3a300b574141de53bb321836eba134e75b210648207dc7b247d1cfce066 not found: ID does not exist" Jul 07 18:02:39.106132 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.106108 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:39.111622 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:39.111600 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-237040df-759cc5f589-mrw8v"] Jul 07 18:02:40.572912 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:02:40.572867 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" path="/var/lib/kubelet/pods/9b39e10c-1cd7-446b-b46e-cd5086ccb76b/volumes" Jul 07 18:04:23.655905 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.655874 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:23.656358 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.656292 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" containerName="maas-api" Jul 07 18:04:23.656358 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.656304 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" containerName="maas-api" Jul 07 18:04:23.656430 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.656369 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b39e10c-1cd7-446b-b46e-cd5086ccb76b" containerName="maas-api" Jul 07 18:04:23.658801 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.658781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.661422 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.661396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-d2c24dd6-serving-cert\"" Jul 07 18:04:23.669171 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.669146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:23.730663 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.730630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.730817 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.730692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsrl\" (UniqueName: \"kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.730817 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.730752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.831906 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.831865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.832074 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.831930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsrl\" (UniqueName: \"kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.832074 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.831994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.832074 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:04:23.832031 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-d2c24dd6-serving-cert: secret "maas-api-e2e-mt-d2c24dd6-serving-cert" not found Jul 07 18:04:23.832174 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:04:23.832100 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls podName:ecd9fe76-125e-46c5-acf9-0e6550d42e43 nodeName:}" failed. No retries permitted until 2026-07-07 18:04:24.332079714 +0000 UTC m=+1666.339312263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls") pod "maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" (UID: "ecd9fe76-125e-46c5-acf9-0e6550d42e43") : secret "maas-api-e2e-mt-d2c24dd6-serving-cert" not found Jul 07 18:04:23.832683 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.832664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:23.840720 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:23.840696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsrl\" (UniqueName: \"kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:24.336114 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:24.336080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:24.338587 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:24.338554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") pod \"maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:24.570798 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:24.570770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:24.703242 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:24.703218 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:24.706114 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:04:24.706088 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd9fe76_125e_46c5_acf9_0e6550d42e43.slice/crio-a5387032b02c39e0b3a311ec02b9b332ad50160dec68ce7860012f693e29cc2b WatchSource:0}: Error finding container a5387032b02c39e0b3a311ec02b9b332ad50160dec68ce7860012f693e29cc2b: Status 404 returned error can't find the container with id a5387032b02c39e0b3a311ec02b9b332ad50160dec68ce7860012f693e29cc2b Jul 07 18:04:25.602134 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:25.602100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" event={"ID":"ecd9fe76-125e-46c5-acf9-0e6550d42e43","Type":"ContainerStarted","Data":"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38"} Jul 07 18:04:25.602312 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:25.602150 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" event={"ID":"ecd9fe76-125e-46c5-acf9-0e6550d42e43","Type":"ContainerStarted","Data":"a5387032b02c39e0b3a311ec02b9b332ad50160dec68ce7860012f693e29cc2b"} Jul 07 18:04:25.602312 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:25.602192 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:25.621421 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:25.621374 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" podStartSLOduration=2.158923089 podStartE2EDuration="2.621359411s" totalImagesPullingTime="462.436322ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:04:25.618755018 +0000 UTC m=+1667.625987587" watchObservedRunningTime="2026-07-07 18:04:25.621359411 +0000 UTC m=+1667.628591959" Jul 07 18:04:31.612929 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:31.612899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:35.924086 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:35.924048 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:35.924550 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:35.924329 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" podUID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" containerName="maas-api" containerID="cri-o://5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38" gracePeriod=30 Jul 07 18:04:36.169847 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.169781 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:36.352522 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.352491 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") pod \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " Jul 07 18:04:36.352683 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.352530 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca\") pod \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " Jul 07 18:04:36.352683 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.352579 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdsrl\" (UniqueName: \"kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl\") pod \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\" (UID: \"ecd9fe76-125e-46c5-acf9-0e6550d42e43\") " Jul 07 18:04:36.352980 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.352939 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecd9fe76-125e-46c5-acf9-0e6550d42e43" (UID: "ecd9fe76-125e-46c5-acf9-0e6550d42e43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:04:36.354651 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.354626 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecd9fe76-125e-46c5-acf9-0e6550d42e43" (UID: "ecd9fe76-125e-46c5-acf9-0e6550d42e43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:04:36.354764 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.354740 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl" (OuterVolumeSpecName: "kube-api-access-rdsrl") pod "ecd9fe76-125e-46c5-acf9-0e6550d42e43" (UID: "ecd9fe76-125e-46c5-acf9-0e6550d42e43"). InnerVolumeSpecName "kube-api-access-rdsrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:04:36.453276 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.453248 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecd9fe76-125e-46c5-acf9-0e6550d42e43-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:04:36.453276 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.453274 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9fe76-125e-46c5-acf9-0e6550d42e43-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:04:36.453431 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.453285 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdsrl\" (UniqueName: \"kubernetes.io/projected/ecd9fe76-125e-46c5-acf9-0e6550d42e43-kube-api-access-rdsrl\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:04:36.653541 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.653445 2567 generic.go:356] "Generic (PLEG): container finished" podID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" containerID="5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38" exitCode=0 Jul 07 18:04:36.653541 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.653494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" event={"ID":"ecd9fe76-125e-46c5-acf9-0e6550d42e43","Type":"ContainerDied","Data":"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38"} Jul 07 18:04:36.653729 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.653549 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" event={"ID":"ecd9fe76-125e-46c5-acf9-0e6550d42e43","Type":"ContainerDied","Data":"a5387032b02c39e0b3a311ec02b9b332ad50160dec68ce7860012f693e29cc2b"} Jul 07 18:04:36.653729 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.653571 2567 scope.go:117] "RemoveContainer" containerID="5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38" Jul 07 18:04:36.653729 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.653506 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx" Jul 07 18:04:36.662413 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.662395 2567 scope.go:117] "RemoveContainer" containerID="5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38" Jul 07 18:04:36.662706 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:04:36.662686 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38\": container with ID starting with 5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38 not found: ID does not exist" containerID="5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38" Jul 07 18:04:36.662793 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.662719 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38"} err="failed to get container status \"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38\": rpc error: code = NotFound desc = could not find container \"5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38\": container with ID starting with 5f6dc0f38278d4ed71e767d2884f36af18a1cd495f6ef79631fe074d435e8f38 not found: ID does not exist" Jul 07 18:04:36.670699 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.670674 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:36.674209 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:36.674189 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-d2c24dd6-77d8c84fdb-rkxfx"] Jul 07 18:04:38.571978 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:04:38.571951 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" path="/var/lib/kubelet/pods/ecd9fe76-125e-46c5-acf9-0e6550d42e43/volumes" Jul 07 18:05:04.817685 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.817647 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:04.819993 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.818200 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" containerName="maas-api" Jul 07 18:05:04.819993 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.818218 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" containerName="maas-api" Jul 07 18:05:04.819993 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.818296 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd9fe76-125e-46c5-acf9-0e6550d42e43" containerName="maas-api" Jul 07 18:05:04.820809 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.820793 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:04.823262 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.823241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-9fc7c3b2-serving-cert\"" Jul 07 18:05:04.868915 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.868890 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:04.921746 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.921715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:04.921901 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.921798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:04.921901 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:04.921830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxsfn\" (UniqueName: \"kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.022992 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.022957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.023187 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.023000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxsfn\" (UniqueName: \"kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.023187 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.023047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.023695 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.023674 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.025464 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.025433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.030775 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.030757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxsfn\" (UniqueName: \"kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn\") pod \"maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.132864 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.132775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.265448 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.265421 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:05.267491 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:05:05.267450 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bf2933_6150_4936_855a_9d24b33d5d31.slice/crio-3eed68c318baed477ea0c58d7400ac68a7fade947b53d9e10f7b998f4780e114 WatchSource:0}: Error finding container 3eed68c318baed477ea0c58d7400ac68a7fade947b53d9e10f7b998f4780e114: Status 404 returned error can't find the container with id 3eed68c318baed477ea0c58d7400ac68a7fade947b53d9e10f7b998f4780e114 Jul 07 18:05:05.269221 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.269201 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:05:05.792513 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.792468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" event={"ID":"40bf2933-6150-4936-855a-9d24b33d5d31","Type":"ContainerStarted","Data":"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49"} Jul 07 18:05:05.792897 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.792521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" event={"ID":"40bf2933-6150-4936-855a-9d24b33d5d31","Type":"ContainerStarted","Data":"3eed68c318baed477ea0c58d7400ac68a7fade947b53d9e10f7b998f4780e114"} Jul 07 18:05:05.792897 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.792623 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:05.813764 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:05.813715 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" podStartSLOduration=1.449690075 podStartE2EDuration="1.813697311s" totalImagesPullingTime="364.007236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:05:05.812560157 +0000 UTC m=+1707.819792726" watchObservedRunningTime="2026-07-07 18:05:05.813697311 +0000 UTC m=+1707.820929883" Jul 07 18:05:11.802623 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:11.802592 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:42.025152 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.025113 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:42.025735 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.025374 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" podUID="40bf2933-6150-4936-855a-9d24b33d5d31" containerName="maas-api" containerID="cri-o://4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49" gracePeriod=30 Jul 07 18:05:42.265958 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.265930 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:42.382122 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.382085 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca\") pod \"40bf2933-6150-4936-855a-9d24b33d5d31\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " Jul 07 18:05:42.382314 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.382134 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxsfn\" (UniqueName: \"kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn\") pod \"40bf2933-6150-4936-855a-9d24b33d5d31\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " Jul 07 18:05:42.382314 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.382195 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls\") pod \"40bf2933-6150-4936-855a-9d24b33d5d31\" (UID: \"40bf2933-6150-4936-855a-9d24b33d5d31\") " Jul 07 18:05:42.382515 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.382446 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40bf2933-6150-4936-855a-9d24b33d5d31" (UID: "40bf2933-6150-4936-855a-9d24b33d5d31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:05:42.384161 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.384139 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn" (OuterVolumeSpecName: "kube-api-access-kxsfn") pod "40bf2933-6150-4936-855a-9d24b33d5d31" (UID: "40bf2933-6150-4936-855a-9d24b33d5d31"). InnerVolumeSpecName "kube-api-access-kxsfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:05:42.384278 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.384258 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40bf2933-6150-4936-855a-9d24b33d5d31" (UID: "40bf2933-6150-4936-855a-9d24b33d5d31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:05:42.483665 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.483640 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40bf2933-6150-4936-855a-9d24b33d5d31-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:05:42.483665 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.483663 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxsfn\" (UniqueName: \"kubernetes.io/projected/40bf2933-6150-4936-855a-9d24b33d5d31-kube-api-access-kxsfn\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:05:42.483800 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.483673 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40bf2933-6150-4936-855a-9d24b33d5d31-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:05:42.977447 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.977415 2567 generic.go:356] "Generic (PLEG): container finished" podID="40bf2933-6150-4936-855a-9d24b33d5d31" containerID="4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49" exitCode=0 Jul 07 18:05:42.977639 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.977490 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" Jul 07 18:05:42.977639 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.977540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" event={"ID":"40bf2933-6150-4936-855a-9d24b33d5d31","Type":"ContainerDied","Data":"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49"} Jul 07 18:05:42.977639 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.977616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh" event={"ID":"40bf2933-6150-4936-855a-9d24b33d5d31","Type":"ContainerDied","Data":"3eed68c318baed477ea0c58d7400ac68a7fade947b53d9e10f7b998f4780e114"} Jul 07 18:05:42.977750 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.977643 2567 scope.go:117] "RemoveContainer" containerID="4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49" Jul 07 18:05:42.987911 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.987893 2567 scope.go:117] "RemoveContainer" containerID="4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49" Jul 07 18:05:42.988166 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:05:42.988147 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49\": container with ID starting with 4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49 not found: ID does not exist" containerID="4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49" Jul 07 18:05:42.988239 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.988172 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49"} err="failed to get container status \"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49\": rpc error: code = NotFound desc = could not find container \"4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49\": container with ID starting with 4891737edb257e63db9b905ccb0e130fe376de5e956eaa995faaa9b1b8c36e49 not found: ID does not exist" Jul 07 18:05:42.994261 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.994238 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:42.995974 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:42.995955 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-9fc7c3b2-7864c55b4-w2fdh"] Jul 07 18:05:44.572632 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:05:44.572594 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bf2933-6150-4936-855a-9d24b33d5d31" path="/var/lib/kubelet/pods/40bf2933-6150-4936-855a-9d24b33d5d31/volumes" Jul 07 18:06:38.550097 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:06:38.550070 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:06:38.552548 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:06:38.552523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:07:33.605138 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.605102 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:07:33.605655 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.605549 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bf2933-6150-4936-855a-9d24b33d5d31" containerName="maas-api" Jul 07 18:07:33.605655 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.605567 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bf2933-6150-4936-855a-9d24b33d5d31" containerName="maas-api" Jul 07 18:07:33.605733 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.605697 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bf2933-6150-4936-855a-9d24b33d5d31" containerName="maas-api" Jul 07 18:07:33.609103 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.609085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.611687 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.611666 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-265893-serving-cert\"" Jul 07 18:07:33.620120 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.620098 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:07:33.732695 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.732653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.732695 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.732697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z654j\" (UniqueName: \"kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.732925 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.732822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.834040 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.834005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.834232 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.834081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.834232 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.834100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z654j\" (UniqueName: \"kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.834715 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.834693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.836648 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.836623 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.842072 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.842046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z654j\" (UniqueName: \"kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j\") pod \"maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:33.922351 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:33.922270 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:34.057885 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:34.057857 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:07:34.059780 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:07:34.059748 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd6923e_ef40_46ec_8a53_334eae2fb3a9.slice/crio-f2f50c83f0aebaa332456c7304457fea156c7001cfd7dc8903be40d2de9b0a5c WatchSource:0}: Error finding container f2f50c83f0aebaa332456c7304457fea156c7001cfd7dc8903be40d2de9b0a5c: Status 404 returned error can't find the container with id f2f50c83f0aebaa332456c7304457fea156c7001cfd7dc8903be40d2de9b0a5c Jul 07 18:07:34.506900 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:34.506872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" event={"ID":"2fd6923e-ef40-46ec-8a53-334eae2fb3a9","Type":"ContainerStarted","Data":"f2f50c83f0aebaa332456c7304457fea156c7001cfd7dc8903be40d2de9b0a5c"} Jul 07 18:07:35.513576 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:35.513539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" event={"ID":"2fd6923e-ef40-46ec-8a53-334eae2fb3a9","Type":"ContainerStarted","Data":"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab"} Jul 07 18:07:35.513998 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:35.513654 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:35.533630 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:35.533579 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" podStartSLOduration=2.14341035 podStartE2EDuration="2.533565418s" totalImagesPullingTime="390.155068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:35.532216619 +0000 UTC m=+1857.539449182" watchObservedRunningTime="2026-07-07 18:07:35.533565418 +0000 UTC m=+1857.540797966" Jul 07 18:07:41.524367 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:41.524338 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:07:42.114640 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.114604 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:07:42.118769 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.118746 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.121629 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.121585 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-24f3c9-serving-cert\"" Jul 07 18:07:42.124960 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.124935 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:07:42.217167 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.217118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrjh\" (UniqueName: \"kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.217334 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.217196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.217334 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.217275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.318742 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.318698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrjh\" (UniqueName: \"kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.318931 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.318806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.318931 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.318855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.319051 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:07:42.319020 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-24f3c9-serving-cert: secret "maas-api-e2e-inf-b-24f3c9-serving-cert" not found Jul 07 18:07:42.319102 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:07:42.319079 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls podName:c8292be3-faf8-45b7-a588-a28cdd4b47ed nodeName:}" failed. No retries permitted until 2026-07-07 18:07:42.819063048 +0000 UTC m=+1864.826295577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls") pod "maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" (UID: "c8292be3-faf8-45b7-a588-a28cdd4b47ed") : secret "maas-api-e2e-inf-b-24f3c9-serving-cert" not found Jul 07 18:07:42.319631 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.319608 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.329622 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.329592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrjh\" (UniqueName: \"kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.823951 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.823920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:42.826310 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:42.826281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") pod \"maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:43.031299 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:43.031262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:43.182340 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:43.182313 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:07:43.184901 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:07:43.184867 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8292be3_faf8_45b7_a588_a28cdd4b47ed.slice/crio-93ec046df8fd35bdb2f84889b27925576ed9388ae51b02f2aaabaf681a28c5eb WatchSource:0}: Error finding container 93ec046df8fd35bdb2f84889b27925576ed9388ae51b02f2aaabaf681a28c5eb: Status 404 returned error can't find the container with id 93ec046df8fd35bdb2f84889b27925576ed9388ae51b02f2aaabaf681a28c5eb Jul 07 18:07:43.553501 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:43.553468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" event={"ID":"c8292be3-faf8-45b7-a588-a28cdd4b47ed","Type":"ContainerStarted","Data":"93ec046df8fd35bdb2f84889b27925576ed9388ae51b02f2aaabaf681a28c5eb"} Jul 07 18:07:44.559918 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:44.559880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" event={"ID":"c8292be3-faf8-45b7-a588-a28cdd4b47ed","Type":"ContainerStarted","Data":"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093"} Jul 07 18:07:44.560310 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:44.560014 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:07:44.577620 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:44.577561 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" podStartSLOduration=2.238829726 podStartE2EDuration="2.577547111s" totalImagesPullingTime="338.717385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:44.574867303 +0000 UTC m=+1866.582099880" watchObservedRunningTime="2026-07-07 18:07:44.577547111 +0000 UTC m=+1866.584779658" Jul 07 18:07:50.573296 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:07:50.573266 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:09:12.519153 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.519092 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:09:12.519993 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.519381 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" podUID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" containerName="maas-api" containerID="cri-o://be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab" gracePeriod=30 Jul 07 18:09:12.765979 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.765952 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:09:12.790205 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.790177 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z654j\" (UniqueName: \"kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j\") pod \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " Jul 07 18:09:12.790359 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.790291 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca\") pod \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " Jul 07 18:09:12.790359 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.790337 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls\") pod \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\" (UID: \"2fd6923e-ef40-46ec-8a53-334eae2fb3a9\") " Jul 07 18:09:12.790648 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.790618 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fd6923e-ef40-46ec-8a53-334eae2fb3a9" (UID: "2fd6923e-ef40-46ec-8a53-334eae2fb3a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:09:12.790752 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.790719 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:12.792325 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.792298 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j" (OuterVolumeSpecName: "kube-api-access-z654j") pod "2fd6923e-ef40-46ec-8a53-334eae2fb3a9" (UID: "2fd6923e-ef40-46ec-8a53-334eae2fb3a9"). InnerVolumeSpecName "kube-api-access-z654j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:09:12.792441 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.792426 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fd6923e-ef40-46ec-8a53-334eae2fb3a9" (UID: "2fd6923e-ef40-46ec-8a53-334eae2fb3a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:09:12.891186 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.891152 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z654j\" (UniqueName: \"kubernetes.io/projected/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-kube-api-access-z654j\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:12.891186 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.891180 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd6923e-ef40-46ec-8a53-334eae2fb3a9-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:12.989002 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.988968 2567 generic.go:356] "Generic (PLEG): container finished" podID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" containerID="be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab" exitCode=0 Jul 07 18:09:12.989190 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.989018 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" Jul 07 18:09:12.989190 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.989026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" event={"ID":"2fd6923e-ef40-46ec-8a53-334eae2fb3a9","Type":"ContainerDied","Data":"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab"} Jul 07 18:09:12.989190 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.989068 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf" event={"ID":"2fd6923e-ef40-46ec-8a53-334eae2fb3a9","Type":"ContainerDied","Data":"f2f50c83f0aebaa332456c7304457fea156c7001cfd7dc8903be40d2de9b0a5c"} Jul 07 18:09:12.989190 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.989093 2567 scope.go:117] "RemoveContainer" containerID="be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab" Jul 07 18:09:12.998572 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.998553 2567 scope.go:117] "RemoveContainer" containerID="be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab" Jul 07 18:09:12.998828 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:09:12.998808 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab\": container with ID starting with be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab not found: ID does not exist" containerID="be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab" Jul 07 18:09:12.998876 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:12.998840 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab"} err="failed to get container status \"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab\": rpc error: code = NotFound desc = could not find container \"be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab\": container with ID starting with be5229bde0ba7480092a5dd1e10ec492c1196aa1893abf63acda237c22fec3ab not found: ID does not exist" Jul 07 18:09:13.010710 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:13.010686 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:09:13.014125 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:13.014098 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-265893-64b9c9c97b-jmmnf"] Jul 07 18:09:14.571797 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:14.571761 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" path="/var/lib/kubelet/pods/2fd6923e-ef40-46ec-8a53-334eae2fb3a9/volumes" Jul 07 18:09:55.743440 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:55.743395 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:09:55.744043 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:55.743671 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" podUID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" containerName="maas-api" containerID="cri-o://63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093" gracePeriod=30 Jul 07 18:09:55.995500 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:55.995430 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:09:56.101922 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.101884 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crrjh\" (UniqueName: \"kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh\") pod \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " Jul 07 18:09:56.102115 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.101931 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca\") pod \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " Jul 07 18:09:56.102115 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.102032 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") pod \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\" (UID: \"c8292be3-faf8-45b7-a588-a28cdd4b47ed\") " Jul 07 18:09:56.102484 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.102317 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8292be3-faf8-45b7-a588-a28cdd4b47ed" (UID: "c8292be3-faf8-45b7-a588-a28cdd4b47ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:09:56.104071 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.104052 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8292be3-faf8-45b7-a588-a28cdd4b47ed" (UID: "c8292be3-faf8-45b7-a588-a28cdd4b47ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:09:56.104192 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.104170 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh" (OuterVolumeSpecName: "kube-api-access-crrjh") pod "c8292be3-faf8-45b7-a588-a28cdd4b47ed" (UID: "c8292be3-faf8-45b7-a588-a28cdd4b47ed"). InnerVolumeSpecName "kube-api-access-crrjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:09:56.198310 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.198271 2567 generic.go:356] "Generic (PLEG): container finished" podID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" containerID="63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093" exitCode=0 Jul 07 18:09:56.198516 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.198316 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" Jul 07 18:09:56.198516 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.198329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" event={"ID":"c8292be3-faf8-45b7-a588-a28cdd4b47ed","Type":"ContainerDied","Data":"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093"} Jul 07 18:09:56.198516 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.198377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs" event={"ID":"c8292be3-faf8-45b7-a588-a28cdd4b47ed","Type":"ContainerDied","Data":"93ec046df8fd35bdb2f84889b27925576ed9388ae51b02f2aaabaf681a28c5eb"} Jul 07 18:09:56.198516 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.198404 2567 scope.go:117] "RemoveContainer" containerID="63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093" Jul 07 18:09:56.202803 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.202783 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8292be3-faf8-45b7-a588-a28cdd4b47ed-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:56.202902 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.202805 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crrjh\" (UniqueName: \"kubernetes.io/projected/c8292be3-faf8-45b7-a588-a28cdd4b47ed-kube-api-access-crrjh\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:56.202902 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.202820 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8292be3-faf8-45b7-a588-a28cdd4b47ed-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:09:56.209307 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.209284 2567 scope.go:117] "RemoveContainer" containerID="63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093" Jul 07 18:09:56.209681 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:09:56.209659 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093\": container with ID starting with 63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093 not found: ID does not exist" containerID="63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093" Jul 07 18:09:56.209780 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.209695 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093"} err="failed to get container status \"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093\": rpc error: code = NotFound desc = could not find container \"63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093\": container with ID starting with 63fce4c0a7283fa3f74f72e70ee6d937a5da1a473b9d6f2df722306060e3a093 not found: ID does not exist" Jul 07 18:09:56.219319 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.219295 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:09:56.221104 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.221084 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-24f3c9-78f7c7ffd9-wvtzs"] Jul 07 18:09:56.571831 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:09:56.571798 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" path="/var/lib/kubelet/pods/c8292be3-faf8-45b7-a588-a28cdd4b47ed/volumes" Jul 07 18:10:04.909958 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.909840 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910232 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910243 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910260 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910265 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910322 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8292be3-faf8-45b7-a588-a28cdd4b47ed" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.910334 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd6923e-ef40-46ec-8a53-334eae2fb3a9" containerName="maas-api" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.915436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.917902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-b6a8e2-serving-cert\"" Jul 07 18:10:04.925555 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.921968 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:04.987538 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.987506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:04.987694 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.987545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:04.987694 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:04.987577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbcqd\" (UniqueName: \"kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.088414 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.088378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbcqd\" (UniqueName: \"kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.088607 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.088502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.088607 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.088523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.088725 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:05.088618 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-b6a8e2-serving-cert: secret "maas-api-e2e-api-a-b6a8e2-serving-cert" not found Jul 07 18:10:05.088725 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:05.088682 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls podName:c6e7aa82-d96a-44f7-9a47-37d936abd859 nodeName:}" failed. No retries permitted until 2026-07-07 18:10:05.58866369 +0000 UTC m=+2007.595896216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls") pod "maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" (UID: "c6e7aa82-d96a-44f7-9a47-37d936abd859") : secret "maas-api-e2e-api-a-b6a8e2-serving-cert" not found Jul 07 18:10:05.089124 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.089104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.096824 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.096802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbcqd\" (UniqueName: \"kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.592733 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.592696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.595128 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.595103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") pod \"maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.828001 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.827961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:05.957515 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.957488 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:05.959209 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:10:05.959182 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e7aa82_d96a_44f7_9a47_37d936abd859.slice/crio-b60d53ac25fbe4b451c16b28f3b386d59a82e4febe002f3b93b9de4778193b7e WatchSource:0}: Error finding container b60d53ac25fbe4b451c16b28f3b386d59a82e4febe002f3b93b9de4778193b7e: Status 404 returned error can't find the container with id b60d53ac25fbe4b451c16b28f3b386d59a82e4febe002f3b93b9de4778193b7e Jul 07 18:10:05.960524 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:05.960506 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:10:06.249913 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:06.249831 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" event={"ID":"c6e7aa82-d96a-44f7-9a47-37d936abd859","Type":"ContainerStarted","Data":"b60d53ac25fbe4b451c16b28f3b386d59a82e4febe002f3b93b9de4778193b7e"} Jul 07 18:10:07.256481 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:07.256426 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" event={"ID":"c6e7aa82-d96a-44f7-9a47-37d936abd859","Type":"ContainerStarted","Data":"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b"} Jul 07 18:10:07.256864 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:07.256571 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:07.274201 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:07.274159 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" podStartSLOduration=2.787259916 podStartE2EDuration="3.274146074s" totalImagesPullingTime="486.886158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:07.272682365 +0000 UTC m=+2009.279914934" watchObservedRunningTime="2026-07-07 18:10:07.274146074 +0000 UTC m=+2009.281378650" Jul 07 18:10:13.266617 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.266585 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:13.460783 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.460749 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:13.468946 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.468925 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.471521 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.471421 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-6020d0-serving-cert\"" Jul 07 18:10:13.475162 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.475142 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:13.565719 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.565686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztlvj\" (UniqueName: \"kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.566046 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.565732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.566046 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.565769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.666984 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.666897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlvj\" (UniqueName: \"kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.666984 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.666940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.666984 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.666975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.667340 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:13.667105 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-6020d0-serving-cert: secret "maas-api-e2e-api-b-6020d0-serving-cert" not found Jul 07 18:10:13.667340 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:13.667169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls podName:36d73c92-21b7-4447-b024-f0975a12e7d6 nodeName:}" failed. No retries permitted until 2026-07-07 18:10:14.167151343 +0000 UTC m=+2016.174383889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls") pod "maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" (UID: "36d73c92-21b7-4447-b024-f0975a12e7d6") : secret "maas-api-e2e-api-b-6020d0-serving-cert" not found Jul 07 18:10:13.667843 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.667823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:13.675269 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:13.675251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlvj\" (UniqueName: \"kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:14.171595 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:14.171555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:14.173987 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:14.173957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") pod \"maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:14.382593 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:14.382565 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:14.517704 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:14.517677 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:14.519949 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:10:14.519921 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d73c92_21b7_4447_b024_f0975a12e7d6.slice/crio-7f3e8a82e448620e3404666a6e6c0ccc86df50b3d198c30479de8e4ac5de4b5d WatchSource:0}: Error finding container 7f3e8a82e448620e3404666a6e6c0ccc86df50b3d198c30479de8e4ac5de4b5d: Status 404 returned error can't find the container with id 7f3e8a82e448620e3404666a6e6c0ccc86df50b3d198c30479de8e4ac5de4b5d Jul 07 18:10:15.298541 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:15.298504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" event={"ID":"36d73c92-21b7-4447-b024-f0975a12e7d6","Type":"ContainerStarted","Data":"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481"} Jul 07 18:10:15.298718 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:15.298589 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" event={"ID":"36d73c92-21b7-4447-b024-f0975a12e7d6","Type":"ContainerStarted","Data":"7f3e8a82e448620e3404666a6e6c0ccc86df50b3d198c30479de8e4ac5de4b5d"} Jul 07 18:10:15.298718 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:15.298654 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:15.316299 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:15.316252 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" podStartSLOduration=1.934736026 podStartE2EDuration="2.316238372s" totalImagesPullingTime="381.502346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:15.314610191 +0000 UTC m=+2017.321842741" watchObservedRunningTime="2026-07-07 18:10:15.316238372 +0000 UTC m=+2017.323470920" Jul 07 18:10:21.309768 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:21.309740 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:26.454019 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.453989 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:26.454439 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.454201 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" podUID="c6e7aa82-d96a-44f7-9a47-37d936abd859" containerName="maas-api" containerID="cri-o://14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b" gracePeriod=30 Jul 07 18:10:26.711445 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.711381 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:26.795161 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.795113 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") pod \"c6e7aa82-d96a-44f7-9a47-37d936abd859\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " Jul 07 18:10:26.795161 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.795171 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca\") pod \"c6e7aa82-d96a-44f7-9a47-37d936abd859\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " Jul 07 18:10:26.795430 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.795248 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbcqd\" (UniqueName: \"kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd\") pod \"c6e7aa82-d96a-44f7-9a47-37d936abd859\" (UID: \"c6e7aa82-d96a-44f7-9a47-37d936abd859\") " Jul 07 18:10:26.795632 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.795608 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6e7aa82-d96a-44f7-9a47-37d936abd859" (UID: "c6e7aa82-d96a-44f7-9a47-37d936abd859"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:10:26.797341 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.797319 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6e7aa82-d96a-44f7-9a47-37d936abd859" (UID: "c6e7aa82-d96a-44f7-9a47-37d936abd859"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:10:26.797405 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.797318 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd" (OuterVolumeSpecName: "kube-api-access-mbcqd") pod "c6e7aa82-d96a-44f7-9a47-37d936abd859" (UID: "c6e7aa82-d96a-44f7-9a47-37d936abd859"). InnerVolumeSpecName "kube-api-access-mbcqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:26.896398 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.896354 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e7aa82-d96a-44f7-9a47-37d936abd859-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:26.896398 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.896393 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e7aa82-d96a-44f7-9a47-37d936abd859-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:26.896398 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:26.896404 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbcqd\" (UniqueName: \"kubernetes.io/projected/c6e7aa82-d96a-44f7-9a47-37d936abd859-kube-api-access-mbcqd\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:27.363361 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.363321 2567 generic.go:356] "Generic (PLEG): container finished" podID="c6e7aa82-d96a-44f7-9a47-37d936abd859" containerID="14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b" exitCode=0 Jul 07 18:10:27.363551 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.363382 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" Jul 07 18:10:27.363551 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.363409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" event={"ID":"c6e7aa82-d96a-44f7-9a47-37d936abd859","Type":"ContainerDied","Data":"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b"} Jul 07 18:10:27.363551 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.363508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw" event={"ID":"c6e7aa82-d96a-44f7-9a47-37d936abd859","Type":"ContainerDied","Data":"b60d53ac25fbe4b451c16b28f3b386d59a82e4febe002f3b93b9de4778193b7e"} Jul 07 18:10:27.363551 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.363532 2567 scope.go:117] "RemoveContainer" containerID="14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b" Jul 07 18:10:27.373176 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.373158 2567 scope.go:117] "RemoveContainer" containerID="14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b" Jul 07 18:10:27.373425 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:27.373407 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b\": container with ID starting with 14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b not found: ID does not exist" containerID="14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b" Jul 07 18:10:27.373498 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.373433 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b"} err="failed to get container status \"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b\": rpc error: code = NotFound desc = could not find container \"14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b\": container with ID starting with 14b9ea5c4d8a6b958cdaea009517acfada8ec02aa780b0e1a4f9529574b12a7b not found: ID does not exist" Jul 07 18:10:27.384446 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.384420 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:27.387386 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:27.387363 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b6a8e2-5bf9c4679d-kr2fw"] Jul 07 18:10:28.573647 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:28.573604 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e7aa82-d96a-44f7-9a47-37d936abd859" path="/var/lib/kubelet/pods/c6e7aa82-d96a-44f7-9a47-37d936abd859/volumes" Jul 07 18:10:33.388142 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.388105 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:33.388614 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.388374 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" podUID="36d73c92-21b7-4447-b024-f0975a12e7d6" containerName="maas-api" containerID="cri-o://f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481" gracePeriod=30 Jul 07 18:10:33.635499 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.635475 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:33.656955 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.656889 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") pod \"36d73c92-21b7-4447-b024-f0975a12e7d6\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " Jul 07 18:10:33.657073 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.657024 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztlvj\" (UniqueName: \"kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj\") pod \"36d73c92-21b7-4447-b024-f0975a12e7d6\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " Jul 07 18:10:33.657133 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.657073 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca\") pod \"36d73c92-21b7-4447-b024-f0975a12e7d6\" (UID: \"36d73c92-21b7-4447-b024-f0975a12e7d6\") " Jul 07 18:10:33.657840 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.657780 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36d73c92-21b7-4447-b024-f0975a12e7d6" (UID: "36d73c92-21b7-4447-b024-f0975a12e7d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:10:33.659313 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.659286 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36d73c92-21b7-4447-b024-f0975a12e7d6" (UID: "36d73c92-21b7-4447-b024-f0975a12e7d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:10:33.659405 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.659339 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj" (OuterVolumeSpecName: "kube-api-access-ztlvj") pod "36d73c92-21b7-4447-b024-f0975a12e7d6" (UID: "36d73c92-21b7-4447-b024-f0975a12e7d6"). InnerVolumeSpecName "kube-api-access-ztlvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:33.757885 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.757851 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztlvj\" (UniqueName: \"kubernetes.io/projected/36d73c92-21b7-4447-b024-f0975a12e7d6-kube-api-access-ztlvj\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:33.757885 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.757881 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36d73c92-21b7-4447-b024-f0975a12e7d6-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:33.757885 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:33.757891 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36d73c92-21b7-4447-b024-f0975a12e7d6-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:10:34.400956 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.400921 2567 generic.go:356] "Generic (PLEG): container finished" podID="36d73c92-21b7-4447-b024-f0975a12e7d6" containerID="f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481" exitCode=0 Jul 07 18:10:34.401373 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.400963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" event={"ID":"36d73c92-21b7-4447-b024-f0975a12e7d6","Type":"ContainerDied","Data":"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481"} Jul 07 18:10:34.401373 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.400967 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" Jul 07 18:10:34.401373 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.401027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps" event={"ID":"36d73c92-21b7-4447-b024-f0975a12e7d6","Type":"ContainerDied","Data":"7f3e8a82e448620e3404666a6e6c0ccc86df50b3d198c30479de8e4ac5de4b5d"} Jul 07 18:10:34.401373 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.401048 2567 scope.go:117] "RemoveContainer" containerID="f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481" Jul 07 18:10:34.410163 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.410143 2567 scope.go:117] "RemoveContainer" containerID="f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481" Jul 07 18:10:34.410422 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:34.410401 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481\": container with ID starting with f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481 not found: ID does not exist" containerID="f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481" Jul 07 18:10:34.410531 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.410429 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481"} err="failed to get container status \"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481\": rpc error: code = NotFound desc = could not find container \"f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481\": container with ID starting with f411214ec40acfc6ddcbd6f4d9a823613d0f097d8c74f070efd1fc796c849481 not found: ID does not exist" Jul 07 18:10:34.423396 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.423267 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:34.425773 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.425749 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6020d0-74dcf96bb9-7xlps"] Jul 07 18:10:34.572081 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:34.572051 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36d73c92-21b7-4447-b024-f0975a12e7d6" path="/var/lib/kubelet/pods/36d73c92-21b7-4447-b024-f0975a12e7d6/volumes" Jul 07 18:10:43.050337 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.050303 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:10:43.050946 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.050925 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e7aa82-d96a-44f7-9a47-37d936abd859" containerName="maas-api" Jul 07 18:10:43.051013 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.050949 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e7aa82-d96a-44f7-9a47-37d936abd859" containerName="maas-api" Jul 07 18:10:43.051013 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.050977 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d73c92-21b7-4447-b024-f0975a12e7d6" containerName="maas-api" Jul 07 18:10:43.051013 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.050986 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d73c92-21b7-4447-b024-f0975a12e7d6" containerName="maas-api" Jul 07 18:10:43.051146 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.051081 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e7aa82-d96a-44f7-9a47-37d936abd859" containerName="maas-api" Jul 07 18:10:43.051146 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.051093 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d73c92-21b7-4447-b024-f0975a12e7d6" containerName="maas-api" Jul 07 18:10:43.054472 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.054434 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.057007 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.056905 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-f78287-serving-cert\"" Jul 07 18:10:43.067359 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.067332 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:10:43.148771 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.148737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqjb\" (UniqueName: \"kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.148952 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.148788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.148952 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.148923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.249449 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.249412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.249696 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.249496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqjb\" (UniqueName: \"kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.249696 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.249527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.250069 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.250048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.251956 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.251932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.257150 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.257125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqjb\" (UniqueName: \"kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb\") pod \"maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.368689 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.368614 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:43.498851 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:43.498825 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:10:43.500863 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:10:43.500838 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ef69d7_9169_4694_9d81_95e6a1d4c246.slice/crio-238dce035c18cf4b59949bc23c5b6270f53f0a2a3f31f9efb90789f23fe31881 WatchSource:0}: Error finding container 238dce035c18cf4b59949bc23c5b6270f53f0a2a3f31f9efb90789f23fe31881: Status 404 returned error can't find the container with id 238dce035c18cf4b59949bc23c5b6270f53f0a2a3f31f9efb90789f23fe31881 Jul 07 18:10:44.450441 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:44.450410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" event={"ID":"32ef69d7-9169-4694-9d81-95e6a1d4c246","Type":"ContainerStarted","Data":"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991"} Jul 07 18:10:44.450855 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:44.450483 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" event={"ID":"32ef69d7-9169-4694-9d81-95e6a1d4c246","Type":"ContainerStarted","Data":"238dce035c18cf4b59949bc23c5b6270f53f0a2a3f31f9efb90789f23fe31881"} Jul 07 18:10:44.450855 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:44.450624 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:44.468023 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:44.467974 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" podStartSLOduration=1.073135698 podStartE2EDuration="1.467959842s" totalImagesPullingTime="394.824144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:44.466316409 +0000 UTC m=+2046.473548982" watchObservedRunningTime="2026-07-07 18:10:44.467959842 +0000 UTC m=+2046.475192390" Jul 07 18:10:50.461566 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:50.461538 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:10:51.254010 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.253974 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:10:51.258171 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.258150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.260780 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.260760 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-5c379c-serving-cert\"" Jul 07 18:10:51.264419 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.264398 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:10:51.328557 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.328528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.328744 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.328574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.328744 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.328627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vp2\" (UniqueName: \"kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.429990 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.429951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.429990 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.429997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.430261 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.430015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vp2\" (UniqueName: \"kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.430261 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:51.430115 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-5c379c-serving-cert: secret "maas-api-e2e-shared-b-5c379c-serving-cert" not found Jul 07 18:10:51.430261 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:10:51.430203 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls podName:11dc69c5-e9af-4066-8957-af130bbf1c1d nodeName:}" failed. No retries permitted until 2026-07-07 18:10:51.930183624 +0000 UTC m=+2053.937416154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls") pod "maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" (UID: "11dc69c5-e9af-4066-8957-af130bbf1c1d") : secret "maas-api-e2e-shared-b-5c379c-serving-cert" not found Jul 07 18:10:51.430646 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.430628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.438536 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.438511 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vp2\" (UniqueName: \"kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.936739 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.936705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:51.939123 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:51.939090 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") pod \"maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:52.173802 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:52.173764 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:52.311669 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:52.311642 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:10:52.313684 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:10:52.313654 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11dc69c5_e9af_4066_8957_af130bbf1c1d.slice/crio-d0df82c44b86ac3b50cdc84b3e3051ac13735058820b893c39a344a01dd600c4 WatchSource:0}: Error finding container d0df82c44b86ac3b50cdc84b3e3051ac13735058820b893c39a344a01dd600c4: Status 404 returned error can't find the container with id d0df82c44b86ac3b50cdc84b3e3051ac13735058820b893c39a344a01dd600c4 Jul 07 18:10:52.491056 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:52.490967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" event={"ID":"11dc69c5-e9af-4066-8957-af130bbf1c1d","Type":"ContainerStarted","Data":"d0df82c44b86ac3b50cdc84b3e3051ac13735058820b893c39a344a01dd600c4"} Jul 07 18:10:53.497522 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:53.497489 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" event={"ID":"11dc69c5-e9af-4066-8957-af130bbf1c1d","Type":"ContainerStarted","Data":"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81"} Jul 07 18:10:53.497963 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:53.497605 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:10:53.515344 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:53.515296 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" podStartSLOduration=2.071541935 podStartE2EDuration="2.515279588s" totalImagesPullingTime="443.737653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:53.51455174 +0000 UTC m=+2055.521784311" watchObservedRunningTime="2026-07-07 18:10:53.515279588 +0000 UTC m=+2055.522512140" Jul 07 18:10:59.509041 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:10:59.509011 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:11:38.582157 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:11:38.582129 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:11:38.586805 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:11:38.586781 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:15:00.137180 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.137147 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-7jvn2"] Jul 07 18:15:00.140960 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.140939 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9"] Jul 07 18:15:00.141095 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.141058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:00.144030 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.144009 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj"] Jul 07 18:15:00.144152 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.144118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:00.147418 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.147398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:00.147721 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.147702 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-7jvn2"] Jul 07 18:15:00.154876 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.154437 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj"] Jul 07 18:15:00.155340 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.155319 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9"] Jul 07 18:15:00.171892 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.171866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rzr\" (UniqueName: \"kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr\") pod \"maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj\" (UID: \"771a4321-9332-4740-95f7-e66079de26e3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:00.171990 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.171913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csjw8\" (UniqueName: \"kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8\") pod \"maas-api-key-cleanup-29724135-7jvn2\" (UID: \"01688816-4936-45e5-89d6-14452491355c\") " pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:00.171990 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.171981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4sc\" (UniqueName: \"kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc\") pod \"maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9\" (UID: \"ac7c76a7-ccb6-4dc7-8094-023577a616aa\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:00.272941 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.272904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rzr\" (UniqueName: \"kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr\") pod \"maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj\" (UID: \"771a4321-9332-4740-95f7-e66079de26e3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:00.273132 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.272947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csjw8\" (UniqueName: \"kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8\") pod \"maas-api-key-cleanup-29724135-7jvn2\" (UID: \"01688816-4936-45e5-89d6-14452491355c\") " pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:00.273132 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.272998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4sc\" (UniqueName: \"kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc\") pod \"maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9\" (UID: \"ac7c76a7-ccb6-4dc7-8094-023577a616aa\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:00.281086 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.281053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rzr\" (UniqueName: \"kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr\") pod \"maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj\" (UID: \"771a4321-9332-4740-95f7-e66079de26e3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:00.281195 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.281121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csjw8\" (UniqueName: \"kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8\") pod \"maas-api-key-cleanup-29724135-7jvn2\" (UID: \"01688816-4936-45e5-89d6-14452491355c\") " pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:00.281320 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.281300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4sc\" (UniqueName: \"kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc\") pod \"maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9\" (UID: \"ac7c76a7-ccb6-4dc7-8094-023577a616aa\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:00.455822 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.455718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:00.466898 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.466870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:00.473939 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.473907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:00.825696 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.825674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-7jvn2"] Jul 07 18:15:00.828061 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:15:00.828034 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01688816_4936_45e5_89d6_14452491355c.slice/crio-eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e WatchSource:0}: Error finding container eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e: Status 404 returned error can't find the container with id eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e Jul 07 18:15:00.840219 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.840195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9"] Jul 07 18:15:00.843199 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:15:00.843173 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7c76a7_ccb6_4dc7_8094_023577a616aa.slice/crio-4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85 WatchSource:0}: Error finding container 4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85: Status 404 returned error can't find the container with id 4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85 Jul 07 18:15:00.866863 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:00.866839 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj"] Jul 07 18:15:00.868257 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:15:00.868236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771a4321_9332_4740_95f7_e66079de26e3.slice/crio-7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80 WatchSource:0}: Error finding container 7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80: Status 404 returned error can't find the container with id 7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80 Jul 07 18:15:01.718634 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.718600 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" event={"ID":"771a4321-9332-4740-95f7-e66079de26e3","Type":"ContainerStarted","Data":"3bacd4bdf1314cefee6d15a33af1a9c8c95d56cbbc12f34d59cc4a042f05f500"} Jul 07 18:15:01.719085 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.718663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" event={"ID":"771a4321-9332-4740-95f7-e66079de26e3","Type":"ContainerStarted","Data":"7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80"} Jul 07 18:15:01.720155 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.720133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" event={"ID":"ac7c76a7-ccb6-4dc7-8094-023577a616aa","Type":"ContainerStarted","Data":"f27d0f6460dddbe4b84d718dfd1b63073e31002de0b2a4aa1da6696a89b928d0"} Jul 07 18:15:01.720250 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.720171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" event={"ID":"ac7c76a7-ccb6-4dc7-8094-023577a616aa","Type":"ContainerStarted","Data":"4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85"} Jul 07 18:15:01.721508 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.721481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" event={"ID":"01688816-4936-45e5-89d6-14452491355c","Type":"ContainerStarted","Data":"de7cfc456c7da51cfc20aeffa4e46d0d19d7a20b5154bd36e71ac10f3e035c86"} Jul 07 18:15:01.721657 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.721519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" event={"ID":"01688816-4936-45e5-89d6-14452491355c","Type":"ContainerStarted","Data":"eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e"} Jul 07 18:15:01.735413 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.735373 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" podStartSLOduration=1.735360215 podStartE2EDuration="1.735360215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:01.733311029 +0000 UTC m=+2303.740543572" watchObservedRunningTime="2026-07-07 18:15:01.735360215 +0000 UTC m=+2303.742592762" Jul 07 18:15:01.756991 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.756943 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" podStartSLOduration=1.75692935 podStartE2EDuration="1.75692935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:01.747967825 +0000 UTC m=+2303.755200374" watchObservedRunningTime="2026-07-07 18:15:01.75692935 +0000 UTC m=+2303.764161897" Jul 07 18:15:01.762194 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:01.762152 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" podStartSLOduration=1.762139006 podStartE2EDuration="1.762139006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:01.761693633 +0000 UTC m=+2303.768926178" watchObservedRunningTime="2026-07-07 18:15:01.762139006 +0000 UTC m=+2303.769371554" Jul 07 18:15:02.728402 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.728370 2567 generic.go:356] "Generic (PLEG): container finished" podID="771a4321-9332-4740-95f7-e66079de26e3" containerID="3bacd4bdf1314cefee6d15a33af1a9c8c95d56cbbc12f34d59cc4a042f05f500" exitCode=0 Jul 07 18:15:02.728830 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.728449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" event={"ID":"771a4321-9332-4740-95f7-e66079de26e3","Type":"ContainerDied","Data":"3bacd4bdf1314cefee6d15a33af1a9c8c95d56cbbc12f34d59cc4a042f05f500"} Jul 07 18:15:02.729950 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.729930 2567 generic.go:356] "Generic (PLEG): container finished" podID="ac7c76a7-ccb6-4dc7-8094-023577a616aa" containerID="f27d0f6460dddbe4b84d718dfd1b63073e31002de0b2a4aa1da6696a89b928d0" exitCode=0 Jul 07 18:15:02.730042 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.730014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" event={"ID":"ac7c76a7-ccb6-4dc7-8094-023577a616aa","Type":"ContainerDied","Data":"f27d0f6460dddbe4b84d718dfd1b63073e31002de0b2a4aa1da6696a89b928d0"} Jul 07 18:15:02.731395 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.731372 2567 generic.go:356] "Generic (PLEG): container finished" podID="01688816-4936-45e5-89d6-14452491355c" containerID="de7cfc456c7da51cfc20aeffa4e46d0d19d7a20b5154bd36e71ac10f3e035c86" exitCode=0 Jul 07 18:15:02.731528 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:02.731399 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" event={"ID":"01688816-4936-45e5-89d6-14452491355c","Type":"ContainerDied","Data":"de7cfc456c7da51cfc20aeffa4e46d0d19d7a20b5154bd36e71ac10f3e035c86"} Jul 07 18:15:03.897173 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:03.897148 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:03.903319 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:03.903293 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csjw8\" (UniqueName: \"kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8\") pod \"01688816-4936-45e5-89d6-14452491355c\" (UID: \"01688816-4936-45e5-89d6-14452491355c\") " Jul 07 18:15:03.905420 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:03.905388 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8" (OuterVolumeSpecName: "kube-api-access-csjw8") pod "01688816-4936-45e5-89d6-14452491355c" (UID: "01688816-4936-45e5-89d6-14452491355c"). InnerVolumeSpecName "kube-api-access-csjw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:15:03.933050 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:03.933030 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:03.936042 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:03.936018 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:04.004661 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.004595 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr4sc\" (UniqueName: \"kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc\") pod \"ac7c76a7-ccb6-4dc7-8094-023577a616aa\" (UID: \"ac7c76a7-ccb6-4dc7-8094-023577a616aa\") " Jul 07 18:15:04.004804 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.004749 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49rzr\" (UniqueName: \"kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr\") pod \"771a4321-9332-4740-95f7-e66079de26e3\" (UID: \"771a4321-9332-4740-95f7-e66079de26e3\") " Jul 07 18:15:04.004973 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.004944 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csjw8\" (UniqueName: \"kubernetes.io/projected/01688816-4936-45e5-89d6-14452491355c-kube-api-access-csjw8\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:15:04.006646 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.006621 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc" (OuterVolumeSpecName: "kube-api-access-kr4sc") pod "ac7c76a7-ccb6-4dc7-8094-023577a616aa" (UID: "ac7c76a7-ccb6-4dc7-8094-023577a616aa"). InnerVolumeSpecName "kube-api-access-kr4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:15:04.006811 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.006789 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr" (OuterVolumeSpecName: "kube-api-access-49rzr") pod "771a4321-9332-4740-95f7-e66079de26e3" (UID: "771a4321-9332-4740-95f7-e66079de26e3"). InnerVolumeSpecName "kube-api-access-49rzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:15:04.105632 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.105599 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49rzr\" (UniqueName: \"kubernetes.io/projected/771a4321-9332-4740-95f7-e66079de26e3-kube-api-access-49rzr\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:15:04.105632 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.105633 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr4sc\" (UniqueName: \"kubernetes.io/projected/ac7c76a7-ccb6-4dc7-8094-023577a616aa-kube-api-access-kr4sc\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:15:04.743730 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.743704 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" Jul 07 18:15:04.743909 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.743745 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-7jvn2" event={"ID":"01688816-4936-45e5-89d6-14452491355c","Type":"ContainerDied","Data":"eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e"} Jul 07 18:15:04.743909 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.743794 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb367136888296c7bb8821a0ef507b178331cd533147a113c10e094ce1f7315e" Jul 07 18:15:04.744991 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.744969 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" Jul 07 18:15:04.744991 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.744974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj" event={"ID":"771a4321-9332-4740-95f7-e66079de26e3","Type":"ContainerDied","Data":"7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80"} Jul 07 18:15:04.745155 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.745018 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e6a9debc31ccef36ad1404b93726d66db9b2b25aabb51ccf60fada156809e80" Jul 07 18:15:04.746280 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.746263 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" Jul 07 18:15:04.746280 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.746280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9" event={"ID":"ac7c76a7-ccb6-4dc7-8094-023577a616aa","Type":"ContainerDied","Data":"4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85"} Jul 07 18:15:04.746494 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:15:04.746318 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bbb8600899231da406e8c36eb7a728ee43aab4af66cebb26428caaac2029c85" Jul 07 18:16:26.355787 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.355754 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:16:26.356314 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.355979 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" podUID="32ef69d7-9169-4694-9d81-95e6a1d4c246" containerName="maas-api" containerID="cri-o://c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991" gracePeriod=30 Jul 07 18:16:26.384107 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.384072 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj"] Jul 07 18:16:26.385908 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.385886 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f78287-29724135-md6sj"] Jul 07 18:16:26.571892 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.571859 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="771a4321-9332-4740-95f7-e66079de26e3" path="/var/lib/kubelet/pods/771a4321-9332-4740-95f7-e66079de26e3/volumes" Jul 07 18:16:26.805339 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.805317 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:16:26.881606 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.881581 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls\") pod \"32ef69d7-9169-4694-9d81-95e6a1d4c246\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " Jul 07 18:16:26.881774 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.881684 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca\") pod \"32ef69d7-9169-4694-9d81-95e6a1d4c246\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " Jul 07 18:16:26.881774 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.881707 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dqjb\" (UniqueName: \"kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb\") pod \"32ef69d7-9169-4694-9d81-95e6a1d4c246\" (UID: \"32ef69d7-9169-4694-9d81-95e6a1d4c246\") " Jul 07 18:16:26.882021 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.881999 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32ef69d7-9169-4694-9d81-95e6a1d4c246" (UID: "32ef69d7-9169-4694-9d81-95e6a1d4c246"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:16:26.883683 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.883651 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32ef69d7-9169-4694-9d81-95e6a1d4c246" (UID: "32ef69d7-9169-4694-9d81-95e6a1d4c246"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:16:26.883784 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.883720 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb" (OuterVolumeSpecName: "kube-api-access-6dqjb") pod "32ef69d7-9169-4694-9d81-95e6a1d4c246" (UID: "32ef69d7-9169-4694-9d81-95e6a1d4c246"). InnerVolumeSpecName "kube-api-access-6dqjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:16:26.982800 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.982776 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32ef69d7-9169-4694-9d81-95e6a1d4c246-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:16:26.982800 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.982798 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dqjb\" (UniqueName: \"kubernetes.io/projected/32ef69d7-9169-4694-9d81-95e6a1d4c246-kube-api-access-6dqjb\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:16:26.982934 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:26.982807 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32ef69d7-9169-4694-9d81-95e6a1d4c246-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:16:27.175025 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.174930 2567 generic.go:356] "Generic (PLEG): container finished" podID="32ef69d7-9169-4694-9d81-95e6a1d4c246" containerID="c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991" exitCode=0 Jul 07 18:16:27.175025 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.174978 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" Jul 07 18:16:27.175025 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.174984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" event={"ID":"32ef69d7-9169-4694-9d81-95e6a1d4c246","Type":"ContainerDied","Data":"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991"} Jul 07 18:16:27.175340 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.175037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2" event={"ID":"32ef69d7-9169-4694-9d81-95e6a1d4c246","Type":"ContainerDied","Data":"238dce035c18cf4b59949bc23c5b6270f53f0a2a3f31f9efb90789f23fe31881"} Jul 07 18:16:27.175340 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.175067 2567 scope.go:117] "RemoveContainer" containerID="c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991" Jul 07 18:16:27.184098 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.184081 2567 scope.go:117] "RemoveContainer" containerID="c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991" Jul 07 18:16:27.184357 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:16:27.184338 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991\": container with ID starting with c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991 not found: ID does not exist" containerID="c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991" Jul 07 18:16:27.184425 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.184366 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991"} err="failed to get container status \"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991\": rpc error: code = NotFound desc = could not find container \"c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991\": container with ID starting with c115ff56bb0c998ab8f4dd0614ed0ffaebae2f76cf1a4d962ba48428c50ca991 not found: ID does not exist" Jul 07 18:16:27.196532 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.196509 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:16:27.199942 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:27.199921 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f78287-86dbb57587-mtzg2"] Jul 07 18:16:28.572435 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:28.572400 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ef69d7-9169-4694-9d81-95e6a1d4c246" path="/var/lib/kubelet/pods/32ef69d7-9169-4694-9d81-95e6a1d4c246/volumes" Jul 07 18:16:38.613333 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:38.613302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:16:38.620026 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:16:38.620004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:17:09.282637 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.282592 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:17:09.283190 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.282858 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerName="maas-api" containerID="cri-o://38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81" gracePeriod=30 Jul 07 18:17:09.308629 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.308561 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9"] Jul 07 18:17:09.310955 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.310931 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-5c379c-29724135-sbkq9"] Jul 07 18:17:09.533090 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.533032 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:17:09.684618 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.684577 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca\") pod \"11dc69c5-e9af-4066-8957-af130bbf1c1d\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " Jul 07 18:17:09.684792 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.684685 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vp2\" (UniqueName: \"kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2\") pod \"11dc69c5-e9af-4066-8957-af130bbf1c1d\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " Jul 07 18:17:09.684792 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.684732 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") pod \"11dc69c5-e9af-4066-8957-af130bbf1c1d\" (UID: \"11dc69c5-e9af-4066-8957-af130bbf1c1d\") " Jul 07 18:17:09.684993 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.684970 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11dc69c5-e9af-4066-8957-af130bbf1c1d" (UID: "11dc69c5-e9af-4066-8957-af130bbf1c1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:17:09.685097 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.685073 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dc69c5-e9af-4066-8957-af130bbf1c1d-openshift-service-ca\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:17:09.686814 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.686783 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11dc69c5-e9af-4066-8957-af130bbf1c1d" (UID: "11dc69c5-e9af-4066-8957-af130bbf1c1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:17:09.686814 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.686788 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2" (OuterVolumeSpecName: "kube-api-access-p9vp2") pod "11dc69c5-e9af-4066-8957-af130bbf1c1d" (UID: "11dc69c5-e9af-4066-8957-af130bbf1c1d"). InnerVolumeSpecName "kube-api-access-p9vp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:17:09.786355 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.786278 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vp2\" (UniqueName: \"kubernetes.io/projected/11dc69c5-e9af-4066-8957-af130bbf1c1d-kube-api-access-p9vp2\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:17:09.786355 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:09.786302 2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dc69c5-e9af-4066-8957-af130bbf1c1d-maas-api-tls\") on node \"ip-10-0-134-236.ec2.internal\" DevicePath \"\"" Jul 07 18:17:10.394167 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.394133 2567 generic.go:356] "Generic (PLEG): container finished" podID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerID="38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81" exitCode=0 Jul 07 18:17:10.394644 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.394177 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" Jul 07 18:17:10.394644 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.394217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" event={"ID":"11dc69c5-e9af-4066-8957-af130bbf1c1d","Type":"ContainerDied","Data":"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81"} Jul 07 18:17:10.394644 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.394268 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" event={"ID":"11dc69c5-e9af-4066-8957-af130bbf1c1d","Type":"ContainerDied","Data":"d0df82c44b86ac3b50cdc84b3e3051ac13735058820b893c39a344a01dd600c4"} Jul 07 18:17:10.394644 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.394300 2567 scope.go:117] "RemoveContainer" containerID="38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81" Jul 07 18:17:10.403691 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.403674 2567 scope.go:117] "RemoveContainer" containerID="38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81" Jul 07 18:17:10.403939 ip-10-0-134-236 kubenswrapper[2567]: E0707 18:17:10.403921 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81\": container with ID starting with 38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81 not found: ID does not exist" containerID="38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81" Jul 07 18:17:10.403987 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.403947 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81"} err="failed to get container status \"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81\": rpc error: code = NotFound desc = could not find container \"38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81\": container with ID starting with 38fc3497b178a4b3eba675cc90dff3c6d64b6d8b98e9721b40a2ab8dad8c5e81 not found: ID does not exist" Jul 07 18:17:10.417959 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.417937 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:17:10.423431 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.423410 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx"] Jul 07 18:17:10.572643 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.572617 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" path="/var/lib/kubelet/pods/11dc69c5-e9af-4066-8957-af130bbf1c1d/volumes" Jul 07 18:17:10.572947 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:10.572932 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7c76a7-ccb6-4dc7-8094-023577a616aa" path="/var/lib/kubelet/pods/ac7c76a7-ccb6-4dc7-8094-023577a616aa/volumes" Jul 07 18:17:12.504606 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:12.504553 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-5c379c-6df57f7876-9qxhx" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.46:8443/health\": context deadline exceeded" Jul 07 18:17:22.719569 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:22.719531 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-77465fb5cc-cbnlm_b5486aec-59df-4cbe-af0a-e9154b30ef48/maas-api/0.log" Jul 07 18:17:22.853289 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:22.853257 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724120-lhc2j_10976261-a6fa-4196-a85c-0d3d44202bf7/cleanup/0.log" Jul 07 18:17:22.972643 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:22.972573 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724135-7jvn2_01688816-4936-45e5-89d6-14452491355c/cleanup/0.log" Jul 07 18:17:23.728430 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:23.728400 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-kfw49_0536145f-aecc-4d7e-bc77-33a44990ff6b/copy-manifests/0.log" Jul 07 18:17:23.735086 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:23.735067 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-kfw49_0536145f-aecc-4d7e-bc77-33a44990ff6b/manager/0.log" Jul 07 18:17:26.657946 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:26.657884 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-42sb5_705cf88f-bd13-40d9-88eb-344f15171e40/discovery/0.log" Jul 07 18:17:27.278341 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:27.278310 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vfj4_a5f81df6-32b0-4588-ae2d-c90009cf4ad0/payload-processing/0.log" Jul 07 18:17:28.131904 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:28.131876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4sdxg_371798ca-da40-494e-a6ad-58b31ff05fbf/main/0.log" Jul 07 18:17:28.252395 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:28.252368 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cj8zn_205be9ae-2fb9-4580-a040-06436c41fe8e/main/0.log" Jul 07 18:17:35.769816 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:35.769762 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x6npr_41a785ab-fa26-4afc-ad92-6201274a38e5/global-pull-secret-syncer/0.log" Jul 07 18:17:35.877875 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:35.877838 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qsmhg_ece089c7-eee1-4848-8f25-398f7fd71344/konnectivity-agent/0.log" Jul 07 18:17:35.943356 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:35.943329 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-236.ec2.internal_dcb28d9929b3a5ac38ae3cfd207b04c4/haproxy/0.log" Jul 07 18:17:44.117323 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.117298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/alertmanager/0.log" Jul 07 18:17:44.136860 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.136839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/config-reloader/0.log" Jul 07 18:17:44.156803 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.156782 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/kube-rbac-proxy-web/0.log" Jul 07 18:17:44.175963 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.175947 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/kube-rbac-proxy/0.log" Jul 07 18:17:44.198794 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.198777 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/kube-rbac-proxy-metric/0.log" Jul 07 18:17:44.215758 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.215732 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/prom-label-proxy/0.log" Jul 07 18:17:44.242034 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.242014 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e6ac113-eb0a-486c-a56b-c1ca39b310f9/init-config-reloader/0.log" Jul 07 18:17:44.379950 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.379866 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bc7bd4768-29hvc_1c04f40c-dc4b-4f03-b213-be6900e1f792/metrics-server/0.log" Jul 07 18:17:44.509706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.509678 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl5s7_017f0c33-3eaf-40a7-99da-b6ed3c72548c/node-exporter/0.log" Jul 07 18:17:44.528637 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.528620 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl5s7_017f0c33-3eaf-40a7-99da-b6ed3c72548c/kube-rbac-proxy/0.log" Jul 07 18:17:44.580849 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.580828 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl5s7_017f0c33-3eaf-40a7-99da-b6ed3c72548c/init-textfile/0.log" Jul 07 18:17:44.679928 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.679838 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bl7k6_71ee25ab-5800-4387-9726-ae53dc09c5d1/kube-rbac-proxy-main/0.log" Jul 07 18:17:44.705082 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.705045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bl7k6_71ee25ab-5800-4387-9726-ae53dc09c5d1/kube-rbac-proxy-self/0.log" Jul 07 18:17:44.726102 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.726079 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bl7k6_71ee25ab-5800-4387-9726-ae53dc09c5d1/openshift-state-metrics/0.log" Jul 07 18:17:44.762995 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.762979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/prometheus/0.log" Jul 07 18:17:44.781812 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.781794 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/config-reloader/0.log" Jul 07 18:17:44.801947 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.801925 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/thanos-sidecar/0.log" Jul 07 18:17:44.822192 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.822173 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/kube-rbac-proxy-web/0.log" Jul 07 18:17:44.841812 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.841796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/kube-rbac-proxy/0.log" Jul 07 18:17:44.863683 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.863665 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/kube-rbac-proxy-thanos/0.log" Jul 07 18:17:44.884745 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.884728 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8965c99c-2c27-4b3b-a9b8-161ca9e31e88/init-config-reloader/0.log" Jul 07 18:17:44.982715 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:44.982664 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff4f4c56d-fxjsx_7f359c3e-196b-4d52-8b11-aee71e3bb204/telemeter-client/0.log" Jul 07 18:17:45.004834 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.004817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff4f4c56d-fxjsx_7f359c3e-196b-4d52-8b11-aee71e3bb204/reload/0.log" Jul 07 18:17:45.024506 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.024491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff4f4c56d-fxjsx_7f359c3e-196b-4d52-8b11-aee71e3bb204/kube-rbac-proxy/0.log" Jul 07 18:17:45.049908 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.049889 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/thanos-query/0.log" Jul 07 18:17:45.072919 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.072899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/kube-rbac-proxy-web/0.log" Jul 07 18:17:45.092404 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.092383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/kube-rbac-proxy/0.log" Jul 07 18:17:45.128324 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.128308 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/prom-label-proxy/0.log" Jul 07 18:17:45.147420 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.147399 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/kube-rbac-proxy-rules/0.log" Jul 07 18:17:45.166567 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:45.166544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7487c6d88c-5sfgg_9bd19bb0-18a2-4485-899c-a4fb63d1da86/kube-rbac-proxy-metrics/0.log" Jul 07 18:17:46.623761 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.623732 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf"] Jul 07 18:17:46.624243 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624224 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ef69d7-9169-4694-9d81-95e6a1d4c246" containerName="maas-api" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624245 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ef69d7-9169-4694-9d81-95e6a1d4c246" containerName="maas-api" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624257 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerName="maas-api" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624264 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerName="maas-api" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624273 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7c76a7-ccb6-4dc7-8094-023577a616aa" containerName="cleanup" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624278 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7c76a7-ccb6-4dc7-8094-023577a616aa" containerName="cleanup" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624288 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771a4321-9332-4740-95f7-e66079de26e3" containerName="cleanup" Jul 07 18:17:46.624306 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624293 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="771a4321-9332-4740-95f7-e66079de26e3" containerName="cleanup" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624333 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01688816-4936-45e5-89d6-14452491355c" containerName="cleanup" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624339 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01688816-4936-45e5-89d6-14452491355c" containerName="cleanup" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624411 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="11dc69c5-e9af-4066-8957-af130bbf1c1d" containerName="maas-api" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624421 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="771a4321-9332-4740-95f7-e66079de26e3" containerName="cleanup" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624432 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01688816-4936-45e5-89d6-14452491355c" containerName="cleanup" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624442 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ef69d7-9169-4694-9d81-95e6a1d4c246" containerName="maas-api" Jul 07 18:17:46.624693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.624450 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7c76a7-ccb6-4dc7-8094-023577a616aa" containerName="cleanup" Jul 07 18:17:46.627693 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.627676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.630119 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.630100 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"kube-root-ca.crt\"" Jul 07 18:17:46.630220 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.630121 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gck5\"/\"default-dockercfg-4gjgh\"" Jul 07 18:17:46.631611 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.631589 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"openshift-service-ca.crt\"" Jul 07 18:17:46.634435 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.634411 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf"] Jul 07 18:17:46.709968 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.709938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-lib-modules\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.710130 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.709974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-podres\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.710130 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.709993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qp7r\" (UniqueName: \"kubernetes.io/projected/1c01c76e-80d1-4a8b-b478-e259f536555a-kube-api-access-9qp7r\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.710130 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.710105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-sys\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.710284 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.710131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-proc\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811308 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-lib-modules\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811493 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-podres\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811493 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qp7r\" (UniqueName: \"kubernetes.io/projected/1c01c76e-80d1-4a8b-b478-e259f536555a-kube-api-access-9qp7r\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811493 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-sys\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811493 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-lib-modules\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811493 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811476 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-podres\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-proc\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-sys\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.811706 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.811542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c01c76e-80d1-4a8b-b478-e259f536555a-proc\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.819505 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.819480 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qp7r\" (UniqueName: \"kubernetes.io/projected/1c01c76e-80d1-4a8b-b478-e259f536555a-kube-api-access-9qp7r\") pod \"perf-node-gather-daemonset-j5cpf\" (UID: \"1c01c76e-80d1-4a8b-b478-e259f536555a\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:46.846848 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.846826 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/1.log" Jul 07 18:17:46.851375 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.851357 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qlqzp_981d40a9-f413-4918-857b-c270bf88ee4d/console-operator/2.log" Jul 07 18:17:46.938761 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:46.938702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:47.068547 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.068497 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf"] Jul 07 18:17:47.075401 ip-10-0-134-236 kubenswrapper[2567]: W0707 18:17:47.075371 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c01c76e_80d1_4a8b_b478_e259f536555a.slice/crio-7b2311aef91c2f883a0ab115f99ac346966996857b28067ed319340e59cee713 WatchSource:0}: Error finding container 7b2311aef91c2f883a0ab115f99ac346966996857b28067ed319340e59cee713: Status 404 returned error can't find the container with id 7b2311aef91c2f883a0ab115f99ac346966996857b28067ed319340e59cee713 Jul 07 18:17:47.372199 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.372167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-858949756f-g72tb_3be7a5a0-abc1-4c36-a6df-653439e25c8d/console/0.log" Jul 07 18:17:47.578037 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.577997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" event={"ID":"1c01c76e-80d1-4a8b-b478-e259f536555a","Type":"ContainerStarted","Data":"b39fd9b3082f1f505e237cf516345c48d43bf2f324053816bbfa89a7f05c0a69"} Jul 07 18:17:47.578206 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.578120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:47.578206 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.578167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" event={"ID":"1c01c76e-80d1-4a8b-b478-e259f536555a","Type":"ContainerStarted","Data":"7b2311aef91c2f883a0ab115f99ac346966996857b28067ed319340e59cee713"} Jul 07 18:17:47.594381 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:47.594334 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" podStartSLOduration=1.594320916 podStartE2EDuration="1.594320916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:17:47.591978626 +0000 UTC m=+2469.599211198" watchObservedRunningTime="2026-07-07 18:17:47.594320916 +0000 UTC m=+2469.601553463" Jul 07 18:17:48.921578 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:48.921550 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p4l64_222eeaeb-5b75-43cc-b6e7-9af69be1c957/dns/0.log" Jul 07 18:17:48.941387 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:48.941361 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p4l64_222eeaeb-5b75-43cc-b6e7-9af69be1c957/kube-rbac-proxy/0.log" Jul 07 18:17:49.009541 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:49.009516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bnfw_4334f7a7-76bb-4b0f-a4ba-ec1f0ed30bd2/dns-node-resolver/0.log" Jul 07 18:17:49.604426 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:49.604393 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgpnx_82ead001-dfc6-4b72-bee7-afb093970c49/node-ca/0.log" Jul 07 18:17:50.650440 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:50.650410 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-42sb5_705cf88f-bd13-40d9-88eb-344f15171e40/discovery/0.log" Jul 07 18:17:50.824912 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:50.824881 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vfj4_a5f81df6-32b0-4588-ae2d-c90009cf4ad0/payload-processing/0.log" Jul 07 18:17:51.491184 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:51.491157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6kf7w_4ef0e22c-86c9-4d02-a1ab-a779ee296596/serve-healthcheck-canary/0.log" Jul 07 18:17:52.063738 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:52.063702 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2m5z_4fe27e8b-4da2-4a5a-bb72-d6d302de9de7/kube-rbac-proxy/0.log" Jul 07 18:17:52.082164 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:52.082140 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2m5z_4fe27e8b-4da2-4a5a-bb72-d6d302de9de7/exporter/0.log" Jul 07 18:17:52.103315 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:52.103296 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2m5z_4fe27e8b-4da2-4a5a-bb72-d6d302de9de7/extractor/0.log" Jul 07 18:17:53.592558 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:53.592531 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-j5cpf" Jul 07 18:17:54.383300 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:54.383271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-77465fb5cc-cbnlm_b5486aec-59df-4cbe-af0a-e9154b30ef48/maas-api/0.log" Jul 07 18:17:54.401575 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:54.401546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724120-lhc2j_10976261-a6fa-4196-a85c-0d3d44202bf7/cleanup/0.log" Jul 07 18:17:54.426758 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:54.426728 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724135-7jvn2_01688816-4936-45e5-89d6-14452491355c/cleanup/0.log" Jul 07 18:17:54.774697 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:54.774614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-kfw49_0536145f-aecc-4d7e-bc77-33a44990ff6b/manager/0.log" Jul 07 18:17:54.794247 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:54.794219 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-kfw49_0536145f-aecc-4d7e-bc77-33a44990ff6b/copy-manifests/0.log" Jul 07 18:17:56.291154 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:56.291127 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55cbfbc7c9-blkl4_e30fa959-dcac-45ce-9d52-fdd5c70b1c61/manager/0.log" Jul 07 18:17:56.317039 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:56.317017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2h8s4_c67fb1b7-98a2-4903-b004-5247fda9b554/openshift-lws-operator/0.log" Jul 07 18:17:57.371413 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:57.371376 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-42sb5_705cf88f-bd13-40d9-88eb-344f15171e40/discovery/0.log" Jul 07 18:17:57.511387 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:57.511354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vfj4_a5f81df6-32b0-4588-ae2d-c90009cf4ad0/payload-processing/0.log" Jul 07 18:17:58.757021 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:58.756950 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-42sb5_705cf88f-bd13-40d9-88eb-344f15171e40/discovery/0.log" Jul 07 18:17:58.921658 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:17:58.921628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5vfj4_a5f81df6-32b0-4588-ae2d-c90009cf4ad0/payload-processing/0.log" Jul 07 18:18:01.541948 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:01.541916 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-zbmxj_4a35f343-d19d-4251-9f8d-097469997f47/kube-storage-version-migrator-operator/1.log" Jul 07 18:18:01.543097 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:01.543074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-zbmxj_4a35f343-d19d-4251-9f8d-097469997f47/kube-storage-version-migrator-operator/0.log" Jul 07 18:18:02.505832 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.505796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2csct_ffe63a58-8548-4c53-b125-2dc2026a881c/kube-multus/0.log" Jul 07 18:18:02.695842 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.695766 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/kube-multus-additional-cni-plugins/0.log" Jul 07 18:18:02.714731 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.714712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/egress-router-binary-copy/0.log" Jul 07 18:18:02.734279 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.734259 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/cni-plugins/0.log" Jul 07 18:18:02.754628 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.754607 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/bond-cni-plugin/0.log" Jul 07 18:18:02.773240 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.773219 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/routeoverride-cni/0.log" Jul 07 18:18:02.792176 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.792157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/whereabouts-cni-bincopy/0.log" Jul 07 18:18:02.814336 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:02.814313 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl42s_5676bc7b-8173-4401-ac13-0fb155cdba80/whereabouts-cni/0.log" Jul 07 18:18:03.005769 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.005665 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5hslb_808da2c9-ea61-4b90-815f-4aa81b55cb44/network-metrics-daemon/0.log" Jul 07 18:18:03.024053 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.024025 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5hslb_808da2c9-ea61-4b90-815f-4aa81b55cb44/kube-rbac-proxy/0.log" Jul 07 18:18:03.896108 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.896079 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/ovn-controller/0.log" Jul 07 18:18:03.911791 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.911769 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/ovn-acl-logging/0.log" Jul 07 18:18:03.933221 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.933190 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/kube-rbac-proxy-node/0.log" Jul 07 18:18:03.952321 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.952296 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 18:18:03.971004 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.970972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/northd/0.log" Jul 07 18:18:03.990002 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:03.989981 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/nbdb/0.log" Jul 07 18:18:04.024565 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:04.024545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/sbdb/0.log" Jul 07 18:18:04.074549 ip-10-0-134-236 kubenswrapper[2567]: I0707 18:18:04.074529 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7dnpq_9282ff21-e3a5-4faf-b52f-cba5853d8f6a/ovnkube-controller/0.log"