Jul 06 17:49:43.351466 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 17:49:43.351480 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 17:49:43.351489 ip-10-0-134-39 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 17:49:43.351803 ip-10-0-134-39 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 17:49:53.599217 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 17:49:53.599236 ip-10-0-134-39 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 907dca8133704b2e83578ff240aa6b88 -- Jul 06 17:51:46.401718 ip-10-0-134-39 systemd[1]: Starting Kubernetes Kubelet... Jul 06 17:51:46.792506 ip-10-0-134-39 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:46.792506 ip-10-0-134-39 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 17:51:46.792506 ip-10-0-134-39 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:46.792506 ip-10-0-134-39 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 17:51:46.792506 ip-10-0-134-39 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:46.793643 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.793517 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 17:51:46.798530 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798515 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.798530 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798530 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798542 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798546 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798550 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798553 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798556 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798559 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798562 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798565 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798568 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798571 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798573 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798576 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798579 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798582 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798584 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798587 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798589 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798594 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798596 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.798599 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798599 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798602 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798605 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798608 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798611 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798614 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798617 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798620 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798624 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798628 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798631 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798634 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798637 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798640 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798644 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798646 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798650 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798653 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798655 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.799195 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798658 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798661 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798663 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798666 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798668 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798671 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798674 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798680 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798684 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798687 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798690 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798693 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798695 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798699 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798704 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798708 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798711 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798715 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798718 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.799960 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798721 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798724 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798727 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798730 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798732 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798736 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798739 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798742 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798745 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798748 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798751 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798753 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798756 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798759 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798761 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798764 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798767 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798769 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798772 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798774 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.800539 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798778 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798780 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798784 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798786 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798789 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798791 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798794 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798797 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798800 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798803 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798806 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798809 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798811 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798814 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798817 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798819 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798822 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798825 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798828 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.801376 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.798831 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801799 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801816 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801822 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801828 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801833 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801842 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801848 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801853 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801858 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801863 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801868 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801872 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801877 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801882 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801887 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801892 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801899 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801906 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.802301 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801911 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801915 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801919 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801924 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801928 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801935 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801942 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801947 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801952 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801957 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801963 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801968 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801973 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801978 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.801994 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802001 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802006 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802010 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802015 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802020 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.803199 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802024 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802029 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802033 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802038 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802042 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802047 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802051 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802056 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802060 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802065 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802070 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802075 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802080 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802085 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802089 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802094 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802098 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802102 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802107 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802111 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.804144 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802116 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802121 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802125 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802129 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802134 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802139 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802143 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802148 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802153 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802158 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802163 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802168 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802172 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802176 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802181 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802186 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802190 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802194 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802199 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.805106 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802206 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802210 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802215 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802220 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802225 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802229 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802235 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802240 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802244 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802249 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802253 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802258 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802262 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802267 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802272 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802276 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802281 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802285 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802290 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802295 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.805681 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802299 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802303 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.802994 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803005 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803010 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803015 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803020 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803025 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803029 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803034 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803039 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803043 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803048 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803052 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803060 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803066 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803071 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803076 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803083 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.806273 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803088 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803093 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803097 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803102 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803107 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803112 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803116 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803120 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803125 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803130 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803134 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803139 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803143 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803149 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803154 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803158 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803162 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803166 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803172 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803176 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.806937 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803181 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803186 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803190 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803195 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803199 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803203 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803207 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803212 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803216 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803221 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803225 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803230 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803237 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803242 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803246 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803251 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803255 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803260 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803264 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.807600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803269 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803273 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803280 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803286 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803291 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803296 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803302 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803306 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803310 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803315 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803320 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803324 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803329 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803335 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803339 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803344 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803348 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803352 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803357 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803361 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.808096 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803366 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803370 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803375 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803379 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803384 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803389 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803394 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803398 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803403 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803407 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803411 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803416 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803423 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803429 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803433 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803439 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803444 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803449 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803453 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803458 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.808844 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803462 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803470 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.803475 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803606 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803619 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803634 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803641 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803648 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803654 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803661 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803667 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803673 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803679 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803685 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803690 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803696 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803702 2555 flags.go:64] FLAG: --cgroup-root="" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803707 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803713 2555 flags.go:64] FLAG: --client-ca-file="" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803719 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803724 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803731 2555 flags.go:64] FLAG: --cluster-domain="" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803736 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803741 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 17:51:46.809378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803747 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803753 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803766 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803771 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803776 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803782 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803787 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803792 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803797 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803806 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803811 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803818 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803823 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803828 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803833 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803838 2555 flags.go:64] FLAG: --enable-server="true" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803843 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803850 2555 flags.go:64] FLAG: --event-burst="100" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803856 2555 flags.go:64] FLAG: --event-qps="50" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803861 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803866 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803871 2555 flags.go:64] FLAG: --eviction-hard="" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803877 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803883 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803888 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 17:51:46.810019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803893 2555 flags.go:64] FLAG: --eviction-soft="" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803899 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803904 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803910 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803915 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803919 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803924 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803929 2555 flags.go:64] FLAG: --feature-gates="" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803936 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803941 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803946 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803951 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803957 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803962 2555 flags.go:64] FLAG: --help="false" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803966 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-134-39.ec2.internal" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803972 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803979 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803985 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803991 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.803997 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804002 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804007 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804011 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 17:51:46.810693 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804016 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804021 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804026 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804031 2555 flags.go:64] FLAG: --kube-reserved="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804036 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804041 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804047 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804051 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804056 2555 flags.go:64] FLAG: --lock-file="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804061 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804066 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804071 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804081 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804086 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804091 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804096 2555 flags.go:64] FLAG: --logging-format="text" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804100 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804106 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804111 2555 flags.go:64] FLAG: --manifest-url="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804116 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804123 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804128 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804136 2555 flags.go:64] FLAG: --max-pods="110" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804141 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804146 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 17:51:46.811339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804152 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804157 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804162 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804167 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804172 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804185 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804191 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804196 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804201 2555 flags.go:64] FLAG: --pod-cidr="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804206 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804216 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804220 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804226 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804230 2555 flags.go:64] FLAG: --port="10250" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804236 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804241 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063c667169c985c92" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804246 2555 flags.go:64] FLAG: --qos-reserved="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804252 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804257 2555 flags.go:64] FLAG: --register-node="true" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804262 2555 flags.go:64] FLAG: --register-with-taints="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804268 2555 flags.go:64] FLAG: --registry-burst="10" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804274 2555 flags.go:64] FLAG: --registry-qps="5" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804279 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804284 2555 flags.go:64] FLAG: --reserved-memory="" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804291 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 17:51:46.812069 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804296 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804301 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804306 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804314 2555 flags.go:64] FLAG: --runonce="false" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804319 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804325 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804330 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804337 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804342 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804348 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804353 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804358 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804363 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804368 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804373 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804378 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804383 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804389 2555 flags.go:64] FLAG: --system-cgroups="" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804393 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804402 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804407 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804412 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804425 2555 flags.go:64] FLAG: --tls-min-version="" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804430 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804434 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 17:51:46.812811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804440 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804445 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804450 2555 flags.go:64] FLAG: --v="2" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804457 2555 flags.go:64] FLAG: --version="false" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804466 2555 flags.go:64] FLAG: --vmodule="" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804473 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.804478 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804693 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804703 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804708 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804717 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804722 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804727 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804735 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804742 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804747 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804753 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804759 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804764 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804769 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804773 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.813459 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804778 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804783 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804787 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804791 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804796 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804800 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804805 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804810 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804815 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804819 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804825 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804829 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804834 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804838 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804842 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804847 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804852 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804857 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804861 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804866 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.814018 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804870 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804876 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804880 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804885 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804889 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804897 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804901 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804906 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804910 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804915 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804920 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804924 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804929 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804934 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804938 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804943 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804947 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804952 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804957 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.814572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804961 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804965 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804969 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804974 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804978 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804983 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804988 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804992 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.804996 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805001 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805006 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805010 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805015 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805019 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805025 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805029 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805034 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805038 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805045 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805049 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.815066 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805054 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805058 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805063 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805067 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805072 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805077 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805085 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805090 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805096 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805101 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805105 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805110 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805115 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805119 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805123 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805127 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805132 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805139 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805145 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.815672 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805150 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805155 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805159 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805164 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805169 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805174 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.805178 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.805972 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.813252 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.813267 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.814159 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.814168 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814234 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814240 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814244 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.816198 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814248 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814251 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814254 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814258 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814261 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814264 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814267 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814270 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814273 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814276 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814278 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814281 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814284 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814287 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814290 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814292 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814295 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814298 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814300 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814303 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.816620 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814306 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814308 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814311 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814314 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814317 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814319 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814324 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814327 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814330 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814333 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814335 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814338 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814341 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814344 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814347 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814349 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814352 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814355 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814359 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.817136 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814363 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814366 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814368 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814371 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814374 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814377 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814380 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814383 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814386 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814388 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814391 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814394 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814397 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814399 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814402 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814405 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814407 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814410 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814413 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814416 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.817675 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814419 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814422 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814425 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814427 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814430 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814433 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814436 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814439 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814452 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814456 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814459 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814461 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814464 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814467 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814469 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814472 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814475 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814478 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814481 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814485 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.818186 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814489 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814492 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814495 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814499 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814503 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814508 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814512 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814515 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814518 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814520 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814523 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814526 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814530 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814535 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814538 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814542 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.818715 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814545 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.814551 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814671 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814677 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814680 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814683 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814686 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814689 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814692 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814694 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814697 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814701 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814705 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814708 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:46.819129 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814712 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814715 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814718 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814721 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814724 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814727 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814730 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814733 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814736 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814740 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814743 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814746 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814749 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814752 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814756 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814758 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814762 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814764 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814767 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814770 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:46.819519 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814773 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814775 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814779 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814781 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814786 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814789 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814792 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814794 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814797 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814800 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814803 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814805 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814808 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814810 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814813 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814816 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814819 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814822 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814824 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814827 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:46.820065 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814832 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814835 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814838 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814840 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814843 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814846 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814849 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814852 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814854 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814857 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814860 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814863 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814865 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814868 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814870 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814874 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814876 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814879 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814881 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814884 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:46.820650 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814886 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814889 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814892 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814894 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814897 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814899 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814902 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814905 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814907 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814910 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814913 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814915 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814919 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814922 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814925 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814927 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814946 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814950 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814953 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814956 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:46.821212 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814959 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814962 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814965 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814968 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814970 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814973 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:46.814976 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.814981 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.815081 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.817245 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.818949 2555 server.go:1019] "Starting client certificate rotation" Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.819061 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.819130 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:51:46.821743 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.821447 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:51:46.826149 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.826131 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:51:46.838475 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.838455 2555 log.go:25] "Validated CRI v1 runtime API" Jul 06 17:51:46.840931 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.840909 2555 log.go:25] "Validated CRI v1 image API" Jul 06 17:51:46.842930 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.842911 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 17:51:46.846448 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.846424 2555 fs.go:135] Filesystem UUIDs: map[5bb48c88-37a0-4ed9-8849-0ba649ea412d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e1dfd2aa-472b-4c99-aa79-d559b18b40d3:/dev/nvme0n1p4] Jul 06 17:51:46.846539 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.846465 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 17:51:46.851784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.851670 2555 manager.go:216] Machine: {Timestamp:2026-07-06 17:51:46.850319456 +0000 UTC m=+0.338846553 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099986 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec223fe2003b8b7abb446e795b117790 SystemUUID:ec223fe2-003b-8b7a-bb44-6e795b117790 BootID:907dca81-3370-4b2e-8357-8ff240aa6b88 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:4d:00:65:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:4d:00:65:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:3e:1b:e4:e2:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 17:51:46.851784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.851781 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 17:51:46.851905 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.851862 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 17:51:46.854992 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.854967 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 17:51:46.855142 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.854995 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 17:51:46.855738 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.855727 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 17:51:46.855772 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.855740 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 17:51:46.855772 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.855748 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:51:46.856344 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.856327 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:51:46.856394 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.856383 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:51:46.857792 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.857781 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 17:51:46.861915 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.861902 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:51:46.862031 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862021 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 17:51:46.862064 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862053 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 06 17:51:46.862064 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862063 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 17:51:46.862118 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862079 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 17:51:46.862118 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862089 2555 kubelet.go:398] "Adding apiserver pod source" Jul 06 17:51:46.862118 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862098 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 17:51:46.862528 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862514 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:51:46.862582 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.862542 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:51:46.864713 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.864690 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 17:51:46.866682 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.866667 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 17:51:46.866742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.866700 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 17:51:46.867836 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867822 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 17:51:46.867880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867845 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 17:51:46.867880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867853 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 17:51:46.867880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867859 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 17:51:46.867880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867872 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 17:51:46.867880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867880 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867889 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867898 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867907 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867914 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867933 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 17:51:46.868019 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.867939 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 17:51:46.868986 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.868971 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 17:51:46.868986 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.868983 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 17:51:46.872176 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.872163 2555 server.go:1268] "Started kubelet" Jul 06 17:51:46.872274 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.872246 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 17:51:46.872329 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.872294 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 17:51:46.872399 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.872372 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 17:51:46.876393 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.876368 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 17:51:46.876412 ip-10-0-134-39 systemd[1]: Started Kubernetes Kubelet. Jul 06 17:51:46.878880 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.878857 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 06 17:51:46.879107 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.879083 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 17:51:46.879424 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.879400 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 17:51:46.879510 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.879476 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 17:51:46.879563 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.879516 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 17:51:46.881939 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.881916 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m6z2d" Jul 06 17:51:46.884935 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.883972 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-39.ec2.internal.18bfc4c01da53185 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-39.ec2.internal,UID:ip-10-0-134-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-39.ec2.internal,},FirstTimestamp:2026-07-06 17:51:46.872136069 +0000 UTC m=+0.360663167,LastTimestamp:2026-07-06 17:51:46.872136069 +0000 UTC m=+0.360663167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-39.ec2.internal,}" Jul 06 17:51:46.885350 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.885334 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 17:51:46.885404 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.885352 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 17:51:46.885934 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.885527 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:46.886140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886123 2555 factory.go:55] Registering systemd factory Jul 06 17:51:46.886237 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886143 2555 factory.go:223] Registration of the systemd container factory successfully Jul 06 17:51:46.886237 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886141 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 17:51:46.886237 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886143 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 17:51:46.886237 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886192 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 17:51:46.886471 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886299 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 06 17:51:46.886471 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886311 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 06 17:51:46.886471 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886435 2555 factory.go:153] Registering CRI-O factory Jul 06 17:51:46.886471 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886450 2555 factory.go:223] Registration of the crio container factory successfully Jul 06 17:51:46.886685 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886504 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 17:51:46.886685 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886525 2555 factory.go:103] Registering Raw factory Jul 06 17:51:46.886685 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886538 2555 manager.go:1196] Started watching for new ooms in manager Jul 06 17:51:46.887142 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.886988 2555 manager.go:349] Starting recovery of all containers Jul 06 17:51:46.892840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.892813 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m6z2d" Jul 06 17:51:46.896441 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.896412 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 17:51:46.896441 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.896430 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 17:51:46.898040 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.897993 2555 manager.go:354] Recovery completed Jul 06 17:51:46.899532 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.899513 2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 17:51:46.902974 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.902961 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:46.904859 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.904843 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:46.904916 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.904876 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:46.904916 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.904891 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:46.905429 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.905410 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 17:51:46.905429 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.905426 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 17:51:46.905587 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.905444 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:51:46.905587 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.905443 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:46.906199 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.906184 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:46.906252 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.906214 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:46.906252 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.906225 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:46.907843 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.907722 2555 policy_none.go:49] "None policy: Start" Jul 06 17:51:46.907910 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.907847 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 17:51:46.907910 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.907859 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 17:51:46.910381 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.910359 2555 policy_none.go:47] "Start" Jul 06 17:51:46.949071 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949051 2555 manager.go:337] "Starting Device Plugin manager" Jul 06 17:51:46.949173 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.949086 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 17:51:46.949173 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949096 2555 server.go:87] "Starting device plugin registration server" Jul 06 17:51:46.949326 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949314 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 17:51:46.949380 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949327 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 17:51:46.949482 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949462 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 17:51:46.949692 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949558 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 17:51:46.949692 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:46.949569 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 17:51:46.950115 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.950093 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 17:51:46.950183 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:46.950158 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.026830 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.026796 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 17:51:47.029097 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.028108 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 17:51:47.029097 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.028146 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 17:51:47.029097 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.028169 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 17:51:47.029097 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.028204 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 17:51:47.034731 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.034712 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:47.049433 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.049389 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:47.050300 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.050282 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:47.050382 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.050318 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:47.050382 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.050335 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:47.050382 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.050367 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.072939 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.072921 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.073009 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.072943 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-39.ec2.internal\": node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.112414 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.112393 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.128554 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.128532 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal"] Jul 06 17:51:47.128610 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.128603 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:47.130094 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.130080 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:47.130153 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.130113 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:47.130153 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.130123 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:47.132489 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.132477 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:47.132601 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.132584 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.132653 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.132615 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:47.133415 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133401 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:47.133415 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133417 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:47.133574 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133449 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:47.133574 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133466 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:47.133574 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133520 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:47.133574 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.133540 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:47.135975 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.135959 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.136066 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.135987 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:47.136761 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.136743 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:47.136863 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.136771 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:47.136863 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.136785 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:47.163224 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.163207 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.167950 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.167932 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.189377 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.189353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.189478 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.189378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.189478 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.189396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.212927 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.212903 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.289676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.289676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.289676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.289871 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289694 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.289871 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.289871 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.289735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.313787 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.313755 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.413886 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.413854 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.470322 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.470284 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.471516 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.471491 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.515037 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.515003 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.617139 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.617055 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.719214 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.719173 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.817700 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.817666 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 17:51:47.818216 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.817830 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:51:47.819990 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.819969 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.895983 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.895900 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 17:46:47 +0000 UTC" deadline="2028-01-17 20:04:57.942103873 +0000 UTC" Jul 06 17:51:47.895983 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.895927 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13442h13m10.046181017s" Jul 06 17:51:47.920815 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:47.920791 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 17:51:47.925885 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.925867 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:47.986495 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.986468 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 17:51:47.998871 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:47.998851 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:51:48.000894 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.000880 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 17:51:48.010599 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.010577 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:51:48.120572 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:48.120530 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc7400c82ada97bc7d9b4033908bae2.slice/crio-a91e473f5fb6dd94ffb5cbb88106c4e4e999a93c6d1cf97171359eb67aad21de WatchSource:0}: Error finding container a91e473f5fb6dd94ffb5cbb88106c4e4e999a93c6d1cf97171359eb67aad21de: Status 404 returned error can't find the container with id a91e473f5fb6dd94ffb5cbb88106c4e4e999a93c6d1cf97171359eb67aad21de Jul 06 17:51:48.126568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.126512 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:51:48.162466 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:48.162441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487ce3ac867cb6a29534fc53f0fccb26.slice/crio-bfbf2206ecd4d6ea4c7ba9fdfd9abb94bea0af0b87cb3edaee29c1440bbc9af4 WatchSource:0}: Error finding container bfbf2206ecd4d6ea4c7ba9fdfd9abb94bea0af0b87cb3edaee29c1440bbc9af4: Status 404 returned error can't find the container with id bfbf2206ecd4d6ea4c7ba9fdfd9abb94bea0af0b87cb3edaee29c1440bbc9af4 Jul 06 17:51:48.330552 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.330514 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:48.379913 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.379889 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:48.715398 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.715370 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:48.863286 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.863252 2555 apiserver.go:52] "Watching apiserver" Jul 06 17:51:48.870940 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.870753 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 17:51:48.874277 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.874246 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-4w9wr","openshift-dns/node-resolver-kcxz5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-9btgh","openshift-multus/multus-t475x","openshift-multus/network-metrics-daemon-z8qkc","kube-system/global-pull-secret-syncer-zfv8j","kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal","openshift-image-registry/node-ca-btjc4","openshift-network-diagnostics/network-check-target-nkqz2","openshift-network-operator/iptables-alerter-52fj4","openshift-ovn-kubernetes/ovnkube-node-shvnq","kube-system/konnectivity-agent-jhl48","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm"] Jul 06 17:51:48.877188 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.877068 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:48.877188 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:48.877143 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:48.879473 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.879425 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:48.882326 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.882302 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 17:51:48.882439 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.882331 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mxs8f\"" Jul 06 17:51:48.882586 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.882568 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.882656 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.882604 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 17:51:48.884857 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.884832 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.885355 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.885282 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.885473 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.885421 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 17:51:48.885648 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.885631 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.885725 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.885677 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6lm29\"" Jul 06 17:51:48.886990 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.886971 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 17:51:48.887284 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.887265 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t475x" Jul 06 17:51:48.888859 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.888684 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.890376 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.889307 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 17:51:48.890376 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.889627 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 17:51:48.890376 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.889670 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 17:51:48.890376 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.890027 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v4v74\"" Jul 06 17:51:48.890376 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.890305 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.890814 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.890386 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:48.890814 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:48.890494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:48.891279 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.891255 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 17:51:48.891629 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.891613 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hqfj2\"" Jul 06 17:51:48.892888 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.892858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:48.895495 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.895476 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.896015 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.895739 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4txcc\"" Jul 06 17:51:48.896015 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.895763 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 17:51:48.896015 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.895828 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.896522 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.896496 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:48.897681 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cnibin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.897681 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-netns\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.897681 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-conf-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.897681 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.897681 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-system-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-socket-dir-parent\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b364dff5-c989-4ff0-842f-b8b2120b3b5e-agent-certs\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b364dff5-c989-4ff0-842f-b8b2120b3b5e-konnectivity-ca\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-socket-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr7s\" (UniqueName: \"kubernetes.io/projected/03e4a3a9-cd21-429c-b14a-0c54fecfae74-kube-api-access-2wr7s\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-os-release\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-multus-certs\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-etc-selinux\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkvc\" (UniqueName: \"kubernetes.io/projected/37ac19bc-1d75-4310-a749-6ce4e942aee2-kube-api-access-mpkvc\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898030 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.897998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-binary-copy\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cni-binary-copy\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjsgh\" (UniqueName: \"kubernetes.io/projected/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-kube-api-access-jjsgh\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-device-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-os-release\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-k8s-cni-cncf-io\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-kubelet\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898252 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cnibin\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-bin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-hostroot\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-registration-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.898568 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-system-cni-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrhm\" (UniqueName: \"kubernetes.io/projected/531fa1a5-8510-4f8a-9b89-a4de09058097-kube-api-access-fqrhm\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898609 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-kubelet-config\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-sys-fs\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-multus\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-daemon-config\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898695 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-etc-kubernetes\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.899566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.898744 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-dbus\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:48.900037 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.899595 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:48.900928 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.900315 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t89xh\"" Jul 06 17:51:48.900928 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.900594 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.902063 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.902046 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:48.902303 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:48.902277 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:51:48.902696 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.902677 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.902809 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.902696 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.903032 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.903009 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-22mbk\"" Jul 06 17:51:48.904578 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.904561 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:48.906247 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.906228 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:51:48.907095 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.907033 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 17:51:48.907095 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.907085 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.907331 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.907315 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.907432 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.907409 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:48.908017 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.907976 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vnths\"" Jul 06 17:51:48.910191 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910114 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 17:51:48.910426 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910407 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47kvm\"" Jul 06 17:51:48.910426 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910419 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 17:51:48.910608 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910422 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 17:51:48.910795 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910775 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 17:51:48.910874 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910835 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 17:51:48.910935 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.910890 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 17:51:48.927852 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.927834 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxp58" Jul 06 17:51:48.935814 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.935797 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxp58" Jul 06 17:51:48.987454 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.987366 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 17:51:48.999581 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-run\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-lib-modules\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-netns\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-system-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-socket-dir-parent\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:48.999742 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-socket-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999761 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-etc-selinux\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f349735-c7e1-4da6-8fdd-f187d5414b53-host\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-var-lib-kubelet\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999849 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-tmp\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-node-log\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-env-overrides\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gcc5\" (UniqueName: \"kubernetes.io/projected/e3c21e59-83bb-4232-8551-ddf84634f4c5-kube-api-access-7gcc5\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:48.999997 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjsgh\" (UniqueName: \"kubernetes.io/projected/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-kube-api-access-jjsgh\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000024 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-device-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbh9x\" (UniqueName: \"kubernetes.io/projected/cb72dd4a-aae6-45ca-a160-bd893955db3e-kube-api-access-tbh9x\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.000060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-tuned\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-netd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cnibin\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000137 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-hostroot\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.000274 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000287 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-registration-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-kubernetes\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.000362 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:49.500319035 +0000 UTC m=+2.988846156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-system-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-cni-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-socket-dir-parent\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-registration-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000582 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.000707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000628 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-device-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000651 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-hostroot\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-socket-dir\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw7qx\" (UniqueName: \"kubernetes.io/projected/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-kube-api-access-nw7qx\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000715 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-etc-selinux\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-system-cni-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000743 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cnibin\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-system-cni-dir\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-kubelet-config\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-systemd\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-kubelet\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-kubelet-config\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-etc-kubernetes\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-dbus\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f349735-c7e1-4da6-8fdd-f187d5414b53-serviceca\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.000995 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cnibin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.001625 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001012 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-etc-kubernetes\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001019 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-netns\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-conf-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tr68\" (UniqueName: \"kubernetes.io/projected/8f349735-c7e1-4da6-8fdd-f187d5414b53-kube-api-access-7tr68\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001090 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-netns\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-var-lib-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001109 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cnibin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87b08b35-7081-421c-9bca-38c58e5e99e8-dbus\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b364dff5-c989-4ff0-842f-b8b2120b3b5e-agent-certs\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-conf-dir\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b364dff5-c989-4ff0-842f-b8b2120b3b5e-konnectivity-ca\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-sys\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb72dd4a-aae6-45ca-a160-bd893955db3e-host-slash\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr7s\" (UniqueName: \"kubernetes.io/projected/03e4a3a9-cd21-429c-b14a-0c54fecfae74-kube-api-access-2wr7s\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-os-release\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-multus-certs\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkvc\" (UniqueName: \"kubernetes.io/projected/37ac19bc-1d75-4310-a749-6ce4e942aee2-kube-api-access-mpkvc\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.002457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-modprobe-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-conf\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-tmp-dir\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-systemd-units\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001559 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-binary-copy\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001597 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-os-release\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001608 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cni-binary-copy\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-slash\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-log-socket\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-script-lib\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-os-release\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001820 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-k8s-cni-cncf-io\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001847 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-kubelet\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysconfig\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.003337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-host\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsx57\" (UniqueName: \"kubernetes.io/projected/0c7cd0aa-779a-4614-9dca-059c29967d7d-kube-api-access-xsx57\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-systemd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.001987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-bin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002046 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb72dd4a-aae6-45ca-a160-bd893955db3e-iptables-alerter-script\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-etc-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002091 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b364dff5-c989-4ff0-842f-b8b2120b3b5e-konnectivity-ca\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-ovn\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002172 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrhm\" (UniqueName: \"kubernetes.io/projected/531fa1a5-8510-4f8a-9b89-a4de09058097-kube-api-access-fqrhm\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-k8s-cni-cncf-io\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-sys-fs\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-hosts-file\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002292 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-bin\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.004178 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-config\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002385 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-multus\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-daemon-config\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002563 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-multus\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-kubelet\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03e4a3a9-cd21-429c-b14a-0c54fecfae74-os-release\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002624 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-var-lib-cni-bin\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.002830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-host-run-multus-certs\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.003040 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.003102 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:49.503086007 +0000 UTC m=+2.991613093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.003116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.003203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37ac19bc-1d75-4310-a749-6ce4e942aee2-sys-fs\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.003508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e4a3a9-cd21-429c-b14a-0c54fecfae74-cni-binary-copy\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.003584 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-cni-binary-copy\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.005007 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.003878 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-multus-daemon-config\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.007171 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.007146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b364dff5-c989-4ff0-842f-b8b2120b3b5e-agent-certs\") pod \"konnectivity-agent-jhl48\" (UID: \"b364dff5-c989-4ff0-842f-b8b2120b3b5e\") " pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:49.012287 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.012221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjsgh\" (UniqueName: \"kubernetes.io/projected/98f318f9-e7be-4929-ac5b-3cf5c18f04b1-kube-api-access-jjsgh\") pod \"multus-t475x\" (UID: \"98f318f9-e7be-4929-ac5b-3cf5c18f04b1\") " pod="openshift-multus/multus-t475x" Jul 06 17:51:49.013242 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.013200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr7s\" (UniqueName: \"kubernetes.io/projected/03e4a3a9-cd21-429c-b14a-0c54fecfae74-kube-api-access-2wr7s\") pod \"multus-additional-cni-plugins-9btgh\" (UID: \"03e4a3a9-cd21-429c-b14a-0c54fecfae74\") " pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.013905 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.013820 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrhm\" (UniqueName: \"kubernetes.io/projected/531fa1a5-8510-4f8a-9b89-a4de09058097-kube-api-access-fqrhm\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:49.015826 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.015800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkvc\" (UniqueName: \"kubernetes.io/projected/37ac19bc-1d75-4310-a749-6ce4e942aee2-kube-api-access-mpkvc\") pod \"aws-ebs-csi-driver-node-58flm\" (UID: \"37ac19bc-1d75-4310-a749-6ce4e942aee2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.034640 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.034589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"487ce3ac867cb6a29534fc53f0fccb26","Type":"ContainerStarted","Data":"bfbf2206ecd4d6ea4c7ba9fdfd9abb94bea0af0b87cb3edaee29c1440bbc9af4"} Jul 06 17:51:49.036537 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.036503 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerStarted","Data":"a91e473f5fb6dd94ffb5cbb88106c4e4e999a93c6d1cf97171359eb67aad21de"} Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.102889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-systemd\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.102936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-kubelet\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.102965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.102974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-systemd\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.102991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f349735-c7e1-4da6-8fdd-f187d5414b53-serviceca\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103017 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-kubelet\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103026 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tr68\" (UniqueName: \"kubernetes.io/projected/8f349735-c7e1-4da6-8fdd-f187d5414b53-kube-api-access-7tr68\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-var-lib-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103135 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-sys\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb72dd4a-aae6-45ca-a160-bd893955db3e-host-slash\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103231 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-modprobe-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103369 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-modprobe-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.103445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103426 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-var-lib-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103492 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-sys\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb72dd4a-aae6-45ca-a160-bd893955db3e-host-slash\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103646 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-conf\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-tmp-dir\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103734 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f349735-c7e1-4da6-8fdd-f187d5414b53-serviceca\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-systemd-units\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-systemd-units\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-slash\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-log-socket\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-script-lib\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysconfig\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-host\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.103975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsx57\" (UniqueName: \"kubernetes.io/projected/0c7cd0aa-779a-4614-9dca-059c29967d7d-kube-api-access-xsx57\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-systemd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-log-socket\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.104271 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104086 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-host\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb72dd4a-aae6-45ca-a160-bd893955db3e-iptables-alerter-script\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104140 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-tmp-dir\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104143 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-etc-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104236 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-ovn\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-ovn\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-hosts-file\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-bin\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104434 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-bin\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-hosts-file\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-config\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104642 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104690 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-run\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-lib-modules\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104731 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-slash\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.105244 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb72dd4a-aae6-45ca-a160-bd893955db3e-iptables-alerter-script\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104775 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-etc-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysconfig\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-run\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104689 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-script-lib\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-netns\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.104866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-conf\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-run-netns\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105033 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-systemd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105077 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-lib-modules\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105118 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f349735-c7e1-4da6-8fdd-f187d5414b53-host\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105151 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovnkube-config\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-var-lib-kubelet\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105233 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f349735-c7e1-4da6-8fdd-f187d5414b53-host\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105240 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-var-lib-kubelet\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105287 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-tmp\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-node-log\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.106150 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-sysctl-d\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-env-overrides\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105453 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gcc5\" (UniqueName: \"kubernetes.io/projected/e3c21e59-83bb-4232-8551-ddf84634f4c5-kube-api-access-7gcc5\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105560 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbh9x\" (UniqueName: \"kubernetes.io/projected/cb72dd4a-aae6-45ca-a160-bd893955db3e-kube-api-access-tbh9x\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-tuned\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-node-log\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105715 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-netd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-run-openvswitch\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105854 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-kubernetes\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.105887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw7qx\" (UniqueName: \"kubernetes.io/projected/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-kube-api-access-nw7qx\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.106160 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c21e59-83bb-4232-8551-ddf84634f4c5-env-overrides\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.106180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c21e59-83bb-4232-8551-ddf84634f4c5-host-cni-netd\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.106350 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-kubernetes\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.107035 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.106544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c21e59-83bb-4232-8551-ddf84634f4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.108823 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.108756 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-tmp\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.111802 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.111737 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c7cd0aa-779a-4614-9dca-059c29967d7d-etc-tuned\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.114051 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.113676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tr68\" (UniqueName: \"kubernetes.io/projected/8f349735-c7e1-4da6-8fdd-f187d5414b53-kube-api-access-7tr68\") pod \"node-ca-btjc4\" (UID: \"8f349735-c7e1-4da6-8fdd-f187d5414b53\") " pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.116118 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.116096 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:49.116223 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.116130 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:49.116223 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.116145 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:49.116223 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.116219 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:49.616200162 +0000 UTC m=+3.104727262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:49.118940 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.118820 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsx57\" (UniqueName: \"kubernetes.io/projected/0c7cd0aa-779a-4614-9dca-059c29967d7d-kube-api-access-xsx57\") pod \"tuned-4w9wr\" (UID: \"0c7cd0aa-779a-4614-9dca-059c29967d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.119379 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.119339 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gcc5\" (UniqueName: \"kubernetes.io/projected/e3c21e59-83bb-4232-8551-ddf84634f4c5-kube-api-access-7gcc5\") pod \"ovnkube-node-shvnq\" (UID: \"e3c21e59-83bb-4232-8551-ddf84634f4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.120465 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.120437 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw7qx\" (UniqueName: \"kubernetes.io/projected/46e7b2c8-5ccb-4f84-b60b-326b7fd52706-kube-api-access-nw7qx\") pod \"node-resolver-kcxz5\" (UID: \"46e7b2c8-5ccb-4f84-b60b-326b7fd52706\") " pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.120774 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.120749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbh9x\" (UniqueName: \"kubernetes.io/projected/cb72dd4a-aae6-45ca-a160-bd893955db3e-kube-api-access-tbh9x\") pod \"iptables-alerter-52fj4\" (UID: \"cb72dd4a-aae6-45ca-a160-bd893955db3e\") " pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.195182 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.195147 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:51:49.204791 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.204765 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" Jul 06 17:51:49.205551 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.205525 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb364dff5_c989_4ff0_842f_b8b2120b3b5e.slice/crio-773a31bd79ebf60957713ef1781ae663ac04768c1f2b1b2309264fcae94e953c WatchSource:0}: Error finding container 773a31bd79ebf60957713ef1781ae663ac04768c1f2b1b2309264fcae94e953c: Status 404 returned error can't find the container with id 773a31bd79ebf60957713ef1781ae663ac04768c1f2b1b2309264fcae94e953c Jul 06 17:51:49.213873 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.213840 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ac19bc_1d75_4310_a749_6ce4e942aee2.slice/crio-b0ccf5b588e462f200e6b54d0f2c6e231f7fa6ece129c22c1274206bdb962f97 WatchSource:0}: Error finding container b0ccf5b588e462f200e6b54d0f2c6e231f7fa6ece129c22c1274206bdb962f97: Status 404 returned error can't find the container with id b0ccf5b588e462f200e6b54d0f2c6e231f7fa6ece129c22c1274206bdb962f97 Jul 06 17:51:49.214563 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.214547 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9btgh" Jul 06 17:51:49.220765 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.220743 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t475x" Jul 06 17:51:49.223973 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.223937 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e4a3a9_cd21_429c_b14a_0c54fecfae74.slice/crio-1b03baf0e54fe812b1e85f783a746b1b2deba05afbc7b1d4387c71c5efa5356e WatchSource:0}: Error finding container 1b03baf0e54fe812b1e85f783a746b1b2deba05afbc7b1d4387c71c5efa5356e: Status 404 returned error can't find the container with id 1b03baf0e54fe812b1e85f783a746b1b2deba05afbc7b1d4387c71c5efa5356e Jul 06 17:51:49.230275 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.230252 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btjc4" Jul 06 17:51:49.230608 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.230583 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f318f9_e7be_4929_ac5b_3cf5c18f04b1.slice/crio-be3e15cae39f7389ac7a6b16e0ffa90af3c557655ee59bf6cdf9bb643591b949 WatchSource:0}: Error finding container be3e15cae39f7389ac7a6b16e0ffa90af3c557655ee59bf6cdf9bb643591b949: Status 404 returned error can't find the container with id be3e15cae39f7389ac7a6b16e0ffa90af3c557655ee59bf6cdf9bb643591b949 Jul 06 17:51:49.238952 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.238907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" Jul 06 17:51:49.242425 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.242407 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f349735_c7e1_4da6_8fdd_f187d5414b53.slice/crio-7e5a92555de998322d1f72b2e566573020470bef0de8b4067d9683bb8e3fcfc7 WatchSource:0}: Error finding container 7e5a92555de998322d1f72b2e566573020470bef0de8b4067d9683bb8e3fcfc7: Status 404 returned error can't find the container with id 7e5a92555de998322d1f72b2e566573020470bef0de8b4067d9683bb8e3fcfc7 Jul 06 17:51:49.247051 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.247031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcxz5" Jul 06 17:51:49.247315 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:49.247292 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7cd0aa_779a_4614_9dca_059c29967d7d.slice/crio-546ad3bc2f72b5939932509e8c0e35d62fc53297939f7d0eddbddb5014271ef2 WatchSource:0}: Error finding container 546ad3bc2f72b5939932509e8c0e35d62fc53297939f7d0eddbddb5014271ef2: Status 404 returned error can't find the container with id 546ad3bc2f72b5939932509e8c0e35d62fc53297939f7d0eddbddb5014271ef2 Jul 06 17:51:49.255721 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.255702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-52fj4" Jul 06 17:51:49.263902 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.263881 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:51:49.509102 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.509053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:49.509292 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.509137 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:49.509292 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.509215 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:49.509292 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.509278 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:49.509491 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.509300 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:50.509274961 +0000 UTC m=+3.997802054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:49.509491 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.509338 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:50.509319738 +0000 UTC m=+3.997846828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:49.710441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.710396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:49.710615 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.710552 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:49.710615 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.710568 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:49.710615 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.710578 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:49.710770 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:49.710631 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:50.710616963 +0000 UTC m=+4.199144047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:49.939657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.939548 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:46:49 +0000 UTC" deadline="2028-04-09 02:21:03.170645552 +0000 UTC" Jul 06 17:51:49.939657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:49.939598 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15416h29m13.231050926s" Jul 06 17:51:50.039910 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.039870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhl48" event={"ID":"b364dff5-c989-4ff0-842f-b8b2120b3b5e","Type":"ContainerStarted","Data":"773a31bd79ebf60957713ef1781ae663ac04768c1f2b1b2309264fcae94e953c"} Jul 06 17:51:50.041243 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.041207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" event={"ID":"0c7cd0aa-779a-4614-9dca-059c29967d7d","Type":"ContainerStarted","Data":"546ad3bc2f72b5939932509e8c0e35d62fc53297939f7d0eddbddb5014271ef2"} Jul 06 17:51:50.042470 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.042412 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btjc4" event={"ID":"8f349735-c7e1-4da6-8fdd-f187d5414b53","Type":"ContainerStarted","Data":"7e5a92555de998322d1f72b2e566573020470bef0de8b4067d9683bb8e3fcfc7"} Jul 06 17:51:50.043797 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.043773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t475x" event={"ID":"98f318f9-e7be-4929-ac5b-3cf5c18f04b1","Type":"ContainerStarted","Data":"be3e15cae39f7389ac7a6b16e0ffa90af3c557655ee59bf6cdf9bb643591b949"} Jul 06 17:51:50.045088 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.045062 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerStarted","Data":"1b03baf0e54fe812b1e85f783a746b1b2deba05afbc7b1d4387c71c5efa5356e"} Jul 06 17:51:50.046270 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.046248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" event={"ID":"37ac19bc-1d75-4310-a749-6ce4e942aee2","Type":"ContainerStarted","Data":"b0ccf5b588e462f200e6b54d0f2c6e231f7fa6ece129c22c1274206bdb962f97"} Jul 06 17:51:50.517371 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.517330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:50.517585 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.517413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:50.517585 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.517535 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:50.517585 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.517558 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:50.517770 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.517619 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:52.517598043 +0000 UTC m=+6.006125143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:50.517770 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.517640 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:52.517629931 +0000 UTC m=+6.006157014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:50.587176 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:50.587143 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c21e59_83bb_4232_8551_ddf84634f4c5.slice/crio-4b3e2dc48a626a51719ae40c4345898decd861c4ba4b6402f8c9500aa30c1af0 WatchSource:0}: Error finding container 4b3e2dc48a626a51719ae40c4345898decd861c4ba4b6402f8c9500aa30c1af0: Status 404 returned error can't find the container with id 4b3e2dc48a626a51719ae40c4345898decd861c4ba4b6402f8c9500aa30c1af0 Jul 06 17:51:50.603138 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:51:50.603110 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e7b2c8_5ccb_4f84_b60b_326b7fd52706.slice/crio-1c93a6c84765e875037422917c02edf98a346d8938fa8d8dd17ead966b324020 WatchSource:0}: Error finding container 1c93a6c84765e875037422917c02edf98a346d8938fa8d8dd17ead966b324020: Status 404 returned error can't find the container with id 1c93a6c84765e875037422917c02edf98a346d8938fa8d8dd17ead966b324020 Jul 06 17:51:50.721051 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.718826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:50.721051 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.719220 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:50.721051 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.719242 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:50.721051 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.719255 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:50.721051 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:50.719313 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:52.719294617 +0000 UTC m=+6.207821719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:50.940854 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.940761 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:46:49 +0000 UTC" deadline="2028-02-28 09:28:30.281837892 +0000 UTC" Jul 06 17:51:50.940854 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:50.940805 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14439h36m39.341039227s" Jul 06 17:51:51.029078 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.029045 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:51.029241 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:51.029178 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:51:51.029694 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.029526 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:51.029694 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:51.029652 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:51.029993 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.029970 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:51.030133 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:51.030092 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:51.057130 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.056477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"487ce3ac867cb6a29534fc53f0fccb26","Type":"ContainerStarted","Data":"6c8459f7cd0dc707768a8f1b0bc46ff6d32812ec6d461fdfbc54c4a07177b81f"} Jul 06 17:51:51.070534 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.068678 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcxz5" event={"ID":"46e7b2c8-5ccb-4f84-b60b-326b7fd52706","Type":"ContainerStarted","Data":"1c93a6c84765e875037422917c02edf98a346d8938fa8d8dd17ead966b324020"} Jul 06 17:51:51.075026 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.074883 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-52fj4" event={"ID":"cb72dd4a-aae6-45ca-a160-bd893955db3e","Type":"ContainerStarted","Data":"24766c266c214352c57f079fc18c4c76b9891046fdd37822d51cb2a246d0f172"} Jul 06 17:51:51.083179 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:51.083078 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"4b3e2dc48a626a51719ae40c4345898decd861c4ba4b6402f8c9500aa30c1af0"} Jul 06 17:51:52.113487 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.112823 2555 generic.go:356] "Generic (PLEG): container finished" podID="bcc7400c82ada97bc7d9b4033908bae2" containerID="94bb983aa8510c0189c0568ad39d91493b4769caba69e7f62e72e64bc2b68e20" exitCode=0 Jul 06 17:51:52.113487 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.113414 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerDied","Data":"94bb983aa8510c0189c0568ad39d91493b4769caba69e7f62e72e64bc2b68e20"} Jul 06 17:51:52.137117 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.137039 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" podStartSLOduration=4.13701786 podStartE2EDuration="4.13701786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:51.076919687 +0000 UTC m=+4.565446797" watchObservedRunningTime="2026-07-06 17:51:52.13701786 +0000 UTC m=+5.625544971" Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.534763 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.534849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.534993 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.535055 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:56.535035989 +0000 UTC m=+10.023563076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.535511 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:52.535607 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.535570 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:56.535550992 +0000 UTC m=+10.024078080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:52.736427 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:52.736385 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:52.736671 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.736626 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:52.736671 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.736657 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:52.736671 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.736672 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:52.736892 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:52.736753 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:56.736731817 +0000 UTC m=+10.225258920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:53.029496 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:53.029638 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:53.030071 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:53.030186 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:53.030257 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:53.030387 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:53.030332 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:51:55.029881 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:55.029802 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:55.030349 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:55.029815 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:55.030349 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:55.029934 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:51:55.030349 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:55.030016 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:55.030349 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:55.030045 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:55.030349 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:55.030164 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:56.571307 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:56.571263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:56.571807 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:56.571348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:56.571807 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.571467 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:56.571807 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.571500 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:56.571807 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.571543 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:04.571523384 +0000 UTC m=+18.060050473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:56.571807 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.571565 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:04.57155381 +0000 UTC m=+18.060080896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:56.774049 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:56.774013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:56.774185 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.774167 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:56.774220 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.774187 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:56.774220 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.774200 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:56.774298 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:56.774268 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:04.774250484 +0000 UTC m=+18.262777568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:57.029986 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:57.029916 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:57.030153 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:57.030006 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:57.030153 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:57.030017 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:57.030153 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:57.030126 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:57.030308 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:57.030178 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:57.030308 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:57.030244 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:51:59.028773 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:59.028738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:51:59.029214 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:59.028738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:51:59.029214 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:59.028882 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:51:59.029214 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:59.029033 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:51:59.029214 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:51:59.029069 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:51:59.029214 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:51:59.029124 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:01.031650 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.031615 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:01.032066 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.031656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:01.032066 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.031703 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:01.032066 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:01.031720 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:01.032066 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:01.031776 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:01.032066 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:01.031854 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:01.132986 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.132901 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerStarted","Data":"604093324ebb431b2c0610e6a13f0bd17c2e2d548045312cf199eec767fc0ba4"} Jul 06 17:52:01.134322 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.134298 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" event={"ID":"0c7cd0aa-779a-4614-9dca-059c29967d7d","Type":"ContainerStarted","Data":"dcb73d297ad19296245aaf8e9ec97bd18ac942c1bb92544e95be4e7c0f22a36d"} Jul 06 17:52:01.135638 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.135615 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btjc4" event={"ID":"8f349735-c7e1-4da6-8fdd-f187d5414b53","Type":"ContainerStarted","Data":"0bb97f14713f3d9e2d955555732d072a0233c8cf4a2f30e131c0c3439d19951d"} Jul 06 17:52:01.136956 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.136937 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="331f026a87d73148053a4cbf2ff541b636c3af3c1c2559a3e159df2f163c1d16" exitCode=0 Jul 06 17:52:01.137027 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.136997 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"331f026a87d73148053a4cbf2ff541b636c3af3c1c2559a3e159df2f163c1d16"} Jul 06 17:52:01.138479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.138457 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhl48" event={"ID":"b364dff5-c989-4ff0-842f-b8b2120b3b5e","Type":"ContainerStarted","Data":"c071c4cb3bdddb3ed114e400b746f064313d55ba2296dbf8f2871fca588d7228"} Jul 06 17:52:01.141929 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.141911 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" event={"ID":"37ac19bc-1d75-4310-a749-6ce4e942aee2","Type":"ContainerStarted","Data":"2f0018e9b0de71ea4c77837af3c273f55941ffd07af68b9db0ecdebbcdc29abe"} Jul 06 17:52:01.143374 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.143354 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcxz5" event={"ID":"46e7b2c8-5ccb-4f84-b60b-326b7fd52706","Type":"ContainerStarted","Data":"ff53bb2396842218018a551f707f9d698dfed24ff876b60afd4cc4e96a6a9ce0"} Jul 06 17:52:01.152658 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.152617 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" podStartSLOduration=13.152603258 podStartE2EDuration="13.152603258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.152511166 +0000 UTC m=+14.641038272" watchObservedRunningTime="2026-07-06 17:52:01.152603258 +0000 UTC m=+14.641130363" Jul 06 17:52:01.169830 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.169783 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jhl48" podStartSLOduration=2.93477173 podStartE2EDuration="14.169769881s" totalImagesPullingTime="11.234998151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.169770742 +0000 UTC m=+14.658297845" watchObservedRunningTime="2026-07-06 17:52:01.169769881 +0000 UTC m=+14.658296985" Jul 06 17:52:01.221919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.221724 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-btjc4" podStartSLOduration=3.022067235 podStartE2EDuration="14.221702285s" totalImagesPullingTime="11.19963505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.221568508 +0000 UTC m=+14.710095611" watchObservedRunningTime="2026-07-06 17:52:01.221702285 +0000 UTC m=+14.710229391" Jul 06 17:52:01.266638 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.266577 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4w9wr" podStartSLOduration=3.069295206 podStartE2EDuration="14.266558248s" totalImagesPullingTime="11.197263042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.246856183 +0000 UTC m=+14.735383289" watchObservedRunningTime="2026-07-06 17:52:01.266558248 +0000 UTC m=+14.755085352" Jul 06 17:52:01.266806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:01.266717 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcxz5" podStartSLOduration=4.430396549 podStartE2EDuration="14.266710352s" totalImagesPullingTime="9.836313803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.26629357 +0000 UTC m=+14.754820675" watchObservedRunningTime="2026-07-06 17:52:01.266710352 +0000 UTC m=+14.755237457" Jul 06 17:52:02.146639 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:02.146600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-52fj4" event={"ID":"cb72dd4a-aae6-45ca-a160-bd893955db3e","Type":"ContainerStarted","Data":"d9284417dc5db85cb40945899554b535bf85d100f558cac3a6cc9ec9b0a53bde"} Jul 06 17:52:02.165454 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:02.165382 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-52fj4" podStartSLOduration=5.298487856 podStartE2EDuration="15.165361945s" totalImagesPullingTime="9.866874089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:02.165087184 +0000 UTC m=+15.653614289" watchObservedRunningTime="2026-07-06 17:52:02.165361945 +0000 UTC m=+15.653889049" Jul 06 17:52:02.322808 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:02.322757 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:02.450989 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:02.450907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:03.028619 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:03.028576 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:03.028619 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:03.028602 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:03.028863 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:03.028583 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:03.028863 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:03.028701 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:03.028863 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:03.028817 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:03.029009 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:03.028916 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:04.636276 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:04.636240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:04.636914 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:04.636312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:04.636914 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.636386 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:52:04.636914 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.636419 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:52:04.636914 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.636476 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:20.636456504 +0000 UTC m=+34.124983597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:52:04.636914 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.636492 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:20.636485616 +0000 UTC m=+34.125012697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:52:04.839096 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:04.839058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:04.839279 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.839256 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:52:04.839338 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.839280 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:52:04.839338 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.839296 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:52:04.839452 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:04.839358 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:20.839336885 +0000 UTC m=+34.327863991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:52:05.029089 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:05.029042 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:05.029264 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:05.029053 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:05.029264 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:05.029173 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:05.029402 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:05.029265 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:05.029402 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:05.029330 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:05.029534 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:05.029445 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:05.957136 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:05.957098 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:52:05.958032 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:05.958012 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:52:07.030002 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:07.029970 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:07.030497 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:07.030130 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:07.030497 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:07.030185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:07.030497 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:07.030260 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:07.030497 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:07.030314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:07.030497 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:07.030435 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:07.295548 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:07.295448 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:08.427866 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:08.427829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:09.029495 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:09.029448 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:09.029768 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:09.029505 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:09.029768 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:09.029448 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:09.029768 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:09.029618 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:09.029768 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:09.029678 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:09.029768 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:09.029730 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:11.028524 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.028490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:11.028991 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.028590 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:11.028991 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:11.028602 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:11.028991 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.028626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:11.028991 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:11.028722 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:11.028991 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:11.028799 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:11.684506 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.684335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:11.696845 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.696823 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 17:52:11.784607 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.784560 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:11.965449 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.965201 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T17:52:11.696838728Z","UUID":"ff614b13-827b-42e7-9095-7483fc07d122","Handler":null,"Name":"","Endpoint":""} Jul 06 17:52:11.966472 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.966455 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 17:52:11.966564 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:11.966486 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 17:52:12.170779 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.170748 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"6302e04ca1141dbeaa1e284136bc681c5c92474f8475bfe3de920d797408d354"} Jul 06 17:52:12.171139 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.170868 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"76458079ef1e7c1ea893beeee83112c30239829ba1e0335d2985b836efc62f7f"} Jul 06 17:52:12.171139 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.170924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"657208b25860a2d04a2306d2353362066ea4838962c2c74e290fc82dce2ad99f"} Jul 06 17:52:12.171139 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.170972 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"d5c07913694f09a73d3009f777b6ad6fd9ec0434451f9ba91e99db47b89322a8"} Jul 06 17:52:12.172407 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.172382 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" event={"ID":"37ac19bc-1d75-4310-a749-6ce4e942aee2","Type":"ContainerStarted","Data":"5c2979cfb726f65bdca2d59095d17fb845f29971dad90e23826513ed4062ac40"} Jul 06 17:52:12.173765 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.173745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t475x" event={"ID":"98f318f9-e7be-4929-ac5b-3cf5c18f04b1","Type":"ContainerStarted","Data":"c1f48ac35ae877af9399ebe69ef91513ba6f1e219f440d77275229861ead95ba"} Jul 06 17:52:12.175519 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.175496 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="ccea09241bbc215131f8b9b37b081e5c6967119056d1d2062ab738706fdd95f6" exitCode=0 Jul 06 17:52:12.175614 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.175530 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"ccea09241bbc215131f8b9b37b081e5c6967119056d1d2062ab738706fdd95f6"} Jul 06 17:52:12.194318 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.193711 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t475x" podStartSLOduration=2.8681326719999998 podStartE2EDuration="25.19369389s" totalImagesPullingTime="22.325561218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:12.193015388 +0000 UTC m=+25.681542495" watchObservedRunningTime="2026-07-06 17:52:12.19369389 +0000 UTC m=+25.682221001" Jul 06 17:52:12.315698 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.315672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:12.415752 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:12.415682 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:13.028884 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.028850 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:13.029000 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.028851 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:13.029000 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:13.028964 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:13.029000 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.028987 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:13.029158 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:13.029083 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:13.029220 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:13.029170 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:13.180938 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.180903 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"5126fef774701cead09a5d3a24768e2ce75c3df5f9f603f3441a794f47d2ac94"} Jul 06 17:52:13.181520 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.180996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"547f99aa8c6399961020002c29a73a7a80cd4cd30fe9098e7025785758b01bda"} Jul 06 17:52:13.183241 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.183208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" event={"ID":"37ac19bc-1d75-4310-a749-6ce4e942aee2","Type":"ContainerStarted","Data":"ac0fa13ccfde00d198bee127c654bb62eb36e111b6e0bf8bba9a9c1b88175d48"} Jul 06 17:52:13.204588 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:13.204540 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58flm" podStartSLOduration=2.852957479 podStartE2EDuration="26.204519384s" totalImagesPullingTime="23.351561905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:13.204376767 +0000 UTC m=+26.692903871" watchObservedRunningTime="2026-07-06 17:52:13.204519384 +0000 UTC m=+26.693046495" Jul 06 17:52:14.187776 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.187740 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="3e9122e59ae8f6262678e194868e54cd08494ce01c296d56ccb92ff58ac6a142" exitCode=0 Jul 06 17:52:14.188456 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.187832 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"3e9122e59ae8f6262678e194868e54cd08494ce01c296d56ccb92ff58ac6a142"} Jul 06 17:52:14.425226 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.425193 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:52:14.425378 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.425318 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 17:52:14.425887 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.425871 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jhl48" Jul 06 17:52:14.496738 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:14.496709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:15.028920 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:15.028887 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:15.029096 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:15.028888 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:15.029096 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:15.029012 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:15.029096 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:15.028894 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:15.029096 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:15.029070 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:15.029314 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:15.029195 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:15.192627 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:15.192599 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"d90286524faf2060b4711d5ae98df7372136361eac2427fa2caa1b7cdcd5b283"} Jul 06 17:52:16.196525 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:16.196483 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="32b356111574c1d39812ec5648e61d7debb230fd25f5a638e18062ca2d94e506" exitCode=0 Jul 06 17:52:16.196911 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:16.196548 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"32b356111574c1d39812ec5648e61d7debb230fd25f5a638e18062ca2d94e506"} Jul 06 17:52:17.029657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.029414 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:17.029842 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.029475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:17.029842 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:17.029756 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:17.029968 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:17.029855 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:17.029968 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.029506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:17.029968 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:17.029924 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:17.203257 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.203217 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" event={"ID":"e3c21e59-83bb-4232-8551-ddf84634f4c5","Type":"ContainerStarted","Data":"75b4600e71ec4169a6a2183f022589dffa64fdf4f02d06aa43fa8bbc4cd44c9d"} Jul 06 17:52:17.203922 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.203528 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:17.220633 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.220611 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:17.235643 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:17.235589 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" podStartSLOduration=9.269076589 podStartE2EDuration="30.235571913s" totalImagesPullingTime="20.966495324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:17.235509262 +0000 UTC m=+30.724036370" watchObservedRunningTime="2026-07-06 17:52:17.235571913 +0000 UTC m=+30.724099009" Jul 06 17:52:18.205885 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.205854 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:18.206365 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.205949 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:18.222024 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.221997 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:18.719956 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.719920 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfv8j"] Jul 06 17:52:18.720153 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.720092 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:18.720228 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:18.720196 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:18.723215 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.723180 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nkqz2"] Jul 06 17:52:18.723341 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.723296 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:18.723451 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:18.723392 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:18.723916 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.723889 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8qkc"] Jul 06 17:52:18.724031 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:18.724012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:18.724154 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:18.724128 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:20.028521 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:20.028483 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:20.029173 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:20.028501 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:20.029173 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.028617 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:20.029173 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.028670 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:20.655289 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:20.655058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:20.655289 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:20.655272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:20.655540 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.655204 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:52:20.655540 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.655372 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:52:20.655540 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.655382 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret podName:87b08b35-7081-421c-9bca-38c58e5e99e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.655360424 +0000 UTC m=+66.143887512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret") pod "global-pull-secret-syncer-zfv8j" (UID: "87b08b35-7081-421c-9bca-38c58e5e99e8") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:52:20.655540 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.655414 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.655401968 +0000 UTC m=+66.143929050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:52:20.856825 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:20.856790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:20.856998 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.856971 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:52:20.856998 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.856994 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:52:20.857076 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.857003 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qg5bx for pod openshift-network-diagnostics/network-check-target-nkqz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:52:20.857076 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:20.857058 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx podName:6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.857044338 +0000 UTC m=+66.345571425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qg5bx" (UniqueName: "kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx") pod "network-check-target-nkqz2" (UID: "6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:52:21.028828 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:21.028784 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:21.029290 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:21.028929 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:21.214954 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:21.214925 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="b1f240b9caf742eba8b4cca928dcdb119832187c5f746c64b84cbab04093d1e6" exitCode=0 Jul 06 17:52:21.215092 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:21.214969 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"b1f240b9caf742eba8b4cca928dcdb119832187c5f746c64b84cbab04093d1e6"} Jul 06 17:52:22.028902 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:22.028868 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:22.028902 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:22.028905 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:22.029385 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:22.028972 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:22.029385 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:22.029103 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:22.220361 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:22.220324 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e4a3a9-cd21-429c-b14a-0c54fecfae74" containerID="6dcb0c65212c1116ecf50579edac0af53edf1b4e4a01a7ccc14736a00e595b9e" exitCode=0 Jul 06 17:52:22.220361 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:22.220359 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerDied","Data":"6dcb0c65212c1116ecf50579edac0af53edf1b4e4a01a7ccc14736a00e595b9e"} Jul 06 17:52:23.028927 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:23.028899 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:23.029363 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:23.029007 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:23.225613 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:23.225579 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9btgh" event={"ID":"03e4a3a9-cd21-429c-b14a-0c54fecfae74","Type":"ContainerStarted","Data":"ce7b9fd25f871a5a9746a3b925251320146d1657bf3b0d978842ac9656a1018c"} Jul 06 17:52:23.250946 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:23.250903 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9btgh" podStartSLOduration=7.81711203 podStartE2EDuration="36.250888082s" totalImagesPullingTime="28.433776052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:23.250048925 +0000 UTC m=+36.738576030" watchObservedRunningTime="2026-07-06 17:52:23.250888082 +0000 UTC m=+36.739415180" Jul 06 17:52:24.029119 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:24.029084 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:24.029613 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:24.029094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:24.029613 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:24.029176 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfv8j" podUID="87b08b35-7081-421c-9bca-38c58e5e99e8" Jul 06 17:52:24.029613 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:24.029255 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nkqz2" podUID="6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c" Jul 06 17:52:25.029374 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.029341 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:25.029755 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:25.029483 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8qkc" podUID="531fa1a5-8510-4f8a-9b89-a4de09058097" Jul 06 17:52:25.339237 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.339204 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeReady" Jul 06 17:52:25.339401 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.339317 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 17:52:25.395531 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.395498 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jzsx2"] Jul 06 17:52:25.416683 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.416657 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4tpbk"] Jul 06 17:52:25.416851 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.416777 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.419142 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.419108 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 17:52:25.419142 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.419108 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 17:52:25.419142 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.419113 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q7vmz\"" Jul 06 17:52:25.419345 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.419251 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 17:52:25.438719 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.438696 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jzsx2"] Jul 06 17:52:25.438719 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.438724 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tpbk"] Jul 06 17:52:25.438874 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.438812 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.441127 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.441107 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 17:52:25.441239 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.441139 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8pm\"" Jul 06 17:52:25.441239 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.441143 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 17:52:25.595919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.595828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxsqc\" (UniqueName: \"kubernetes.io/projected/073b3339-f45e-4835-a8a7-c57f39360b4f-kube-api-access-gxsqc\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.595919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.595872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-tmp-dir\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.595919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.595888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.595919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.595907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073b3339-f45e-4835-a8a7-c57f39360b4f-cert\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.595919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.595926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q5gb\" (UniqueName: \"kubernetes.io/projected/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-kube-api-access-6q5gb\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.596202 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.596008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-config-volume\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.696639 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696603 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-config-volume\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.696753 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxsqc\" (UniqueName: \"kubernetes.io/projected/073b3339-f45e-4835-a8a7-c57f39360b4f-kube-api-access-gxsqc\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.696818 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-tmp-dir\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.696853 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.696908 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073b3339-f45e-4835-a8a7-c57f39360b4f-cert\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.696947 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.696927 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q5gb\" (UniqueName: \"kubernetes.io/projected/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-kube-api-access-6q5gb\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.696985 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:25.696944 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:25.697028 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:25.697001 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:26.196982826 +0000 UTC m=+39.685509911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:25.697248 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.697230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-tmp-dir\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.697325 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.697279 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-config-volume\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.701093 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.701070 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073b3339-f45e-4835-a8a7-c57f39360b4f-cert\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.706337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.706315 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxsqc\" (UniqueName: \"kubernetes.io/projected/073b3339-f45e-4835-a8a7-c57f39360b4f-kube-api-access-gxsqc\") pod \"ingress-canary-jzsx2\" (UID: \"073b3339-f45e-4835-a8a7-c57f39360b4f\") " pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.706452 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.706376 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q5gb\" (UniqueName: \"kubernetes.io/projected/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-kube-api-access-6q5gb\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:25.725347 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.725325 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jzsx2" Jul 06 17:52:25.893310 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:25.893090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jzsx2"] Jul 06 17:52:25.896904 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:25.896875 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073b3339_f45e_4835_a8a7_c57f39360b4f.slice/crio-7184e43ec9b219dd8d3a27c3e1df35be312a19f9a6e64002bf4c708fe1fe744a WatchSource:0}: Error finding container 7184e43ec9b219dd8d3a27c3e1df35be312a19f9a6e64002bf4c708fe1fe744a: Status 404 returned error can't find the container with id 7184e43ec9b219dd8d3a27c3e1df35be312a19f9a6e64002bf4c708fe1fe744a Jul 06 17:52:26.029305 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.029267 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:26.029513 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.029269 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:26.032830 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.032808 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvljr\"" Jul 06 17:52:26.032830 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.032822 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:52:26.033014 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.032865 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:52:26.033014 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.032871 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:52:26.201091 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.200990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:26.201227 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:26.201151 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:26.201227 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:26.201216 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:27.201198465 +0000 UTC m=+40.689725547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:26.233252 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:26.233212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jzsx2" event={"ID":"073b3339-f45e-4835-a8a7-c57f39360b4f","Type":"ContainerStarted","Data":"7184e43ec9b219dd8d3a27c3e1df35be312a19f9a6e64002bf4c708fe1fe744a"} Jul 06 17:52:27.029890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:27.029858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:27.035167 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:27.034932 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:52:27.035167 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:27.035083 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-22ww9\"" Jul 06 17:52:27.209384 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:27.209355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:27.209691 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:27.209667 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:27.209825 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:27.209746 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:29.209724286 +0000 UTC m=+42.698251376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:29.222861 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:29.222778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:29.223194 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:29.222879 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:29.223194 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:29.222930 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:33.222915564 +0000 UTC m=+46.711442652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:29.241326 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:29.241295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jzsx2" event={"ID":"073b3339-f45e-4835-a8a7-c57f39360b4f","Type":"ContainerStarted","Data":"fd47dc9a596339fa3f9c5afee342849ed3493c4b22c0dba2903086edd127a9b5"} Jul 06 17:52:29.258179 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:29.258133 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jzsx2" podStartSLOduration=1.281281906 podStartE2EDuration="4.258119941s" totalImagesPullingTime="2.976838035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:29.257936005 +0000 UTC m=+42.746463108" watchObservedRunningTime="2026-07-06 17:52:29.258119941 +0000 UTC m=+42.746647042" Jul 06 17:52:33.248173 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:33.248133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:33.248556 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:33.248298 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:33.248556 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:33.248374 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:41.248358199 +0000 UTC m=+54.736885282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:41.305010 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:41.304974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:41.305558 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:41.305083 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:41.305558 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:41.305141 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:52:57.305128099 +0000 UTC m=+70.793655181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:46.507066 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.507032 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj"] Jul 06 17:52:46.541837 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.541802 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj"] Jul 06 17:52:46.541984 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.541895 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.546001 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.545976 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 17:52:46.546975 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.546955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 17:52:46.547085 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.547010 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 17:52:46.547085 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.547027 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 17:52:46.547200 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.547121 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p7vm7\"" Jul 06 17:52:46.642296 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.642259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th299\" (UniqueName: \"kubernetes.io/projected/6a684cf9-de28-4f55-b6fd-bf14e2888558-kube-api-access-th299\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.642480 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.642322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.642480 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.642364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a684cf9-de28-4f55-b6fd-bf14e2888558-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.743571 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.743535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a684cf9-de28-4f55-b6fd-bf14e2888558-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.743718 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.743598 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th299\" (UniqueName: \"kubernetes.io/projected/6a684cf9-de28-4f55-b6fd-bf14e2888558-kube-api-access-th299\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.743718 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.743640 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.743786 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:46.743766 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:46.743848 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:46.743838 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:47.243818905 +0000 UTC m=+60.732345993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:46.744232 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.744214 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a684cf9-de28-4f55-b6fd-bf14e2888558-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:46.770526 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:46.770466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th299\" (UniqueName: \"kubernetes.io/projected/6a684cf9-de28-4f55-b6fd-bf14e2888558-kube-api-access-th299\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:47.246700 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:47.246614 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:47.246843 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:47.246761 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:47.246843 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:47.246826 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:48.246809916 +0000 UTC m=+61.735336998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:48.253111 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:48.253072 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:48.253525 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:48.253223 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:48.253525 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:48.253286 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:50.253271557 +0000 UTC m=+63.741798644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:50.220735 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.220709 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shvnq" Jul 06 17:52:50.265241 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.265203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:50.265450 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.265317 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:50.265450 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.265405 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.265380463 +0000 UTC m=+67.753907563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:50.633218 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.633189 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fntcq"] Jul 06 17:52:50.636024 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.636004 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.643006 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.642983 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 17:52:50.643553 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.643538 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 17:52:50.643644 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.643629 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 17:52:50.643918 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.643901 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 17:52:50.643995 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.643904 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j6zr4\"" Jul 06 17:52:50.653083 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.653060 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fntcq"] Jul 06 17:52:50.667550 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.667525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb8769a4-8722-40b6-a739-47f87f88cf3a-crio-socket\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.667639 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.667553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltl5\" (UniqueName: \"kubernetes.io/projected/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-api-access-wltl5\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.667639 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.667596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.667639 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.667621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.667734 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.667641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb8769a4-8722-40b6-a739-47f87f88cf3a-data-volume\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768204 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb8769a4-8722-40b6-a739-47f87f88cf3a-crio-socket\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768364 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768212 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltl5\" (UniqueName: \"kubernetes.io/projected/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-api-access-wltl5\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768364 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768297 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb8769a4-8722-40b6-a739-47f87f88cf3a-crio-socket\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768364 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768339 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768512 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768512 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb8769a4-8722-40b6-a739-47f87f88cf3a-data-volume\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.768512 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.768488 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:50.768512 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.768495 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:50.768689 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.768552 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:51.268535494 +0000 UTC m=+64.757062577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : configmap "kube-rbac-proxy" not found Jul 06 17:52:50.768689 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:50.768575 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:51.268560816 +0000 UTC m=+64.757087898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:50.768795 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.768754 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb8769a4-8722-40b6-a739-47f87f88cf3a-data-volume\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:50.786595 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:50.786565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltl5\" (UniqueName: \"kubernetes.io/projected/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-api-access-wltl5\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:51.271214 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:51.271177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:51.271214 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:51.271223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:51.271752 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:51.271329 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:51.271752 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:51.271367 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:51.271752 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:51.271404 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.27138734 +0000 UTC m=+65.759914425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:51.271752 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:51.271419 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.271411694 +0000 UTC m=+65.759938776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : configmap "kube-rbac-proxy" not found Jul 06 17:52:52.276657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.276615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:52.276657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.276656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:52.277086 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.276758 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:52.277086 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.276780 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:52.277086 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.276821 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.276806024 +0000 UTC m=+67.765333107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:52.277086 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.276835 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.276829247 +0000 UTC m=+67.765356329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : configmap "kube-rbac-proxy" not found Jul 06 17:52:52.679401 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.679319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:52:52.679401 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.679386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:52.682108 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.682090 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:52:52.682185 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.682143 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:52:52.690201 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.690181 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:52:52.690305 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:52.690249 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs podName:531fa1a5-8510-4f8a-9b89-a4de09058097 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:56.690234194 +0000 UTC m=+130.178761276 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs") pod "network-metrics-daemon-z8qkc" (UID: "531fa1a5-8510-4f8a-9b89-a4de09058097") : secret "metrics-daemon-secret" not found Jul 06 17:52:52.692246 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.692228 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87b08b35-7081-421c-9bca-38c58e5e99e8-original-pull-secret\") pod \"global-pull-secret-syncer-zfv8j\" (UID: \"87b08b35-7081-421c-9bca-38c58e5e99e8\") " pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:52.740365 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.740333 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfv8j" Jul 06 17:52:52.832268 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.832231 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcxz5_46e7b2c8-5ccb-4f84-b60b-326b7fd52706/dns-node-resolver/0.log" Jul 06 17:52:52.880971 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.880943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:52.883683 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.883659 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:52:52.893807 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.893778 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:52:52.904344 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.904316 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfv8j"] Jul 06 17:52:52.905304 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:52.905284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg5bx\" (UniqueName: \"kubernetes.io/projected/6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c-kube-api-access-qg5bx\") pod \"network-check-target-nkqz2\" (UID: \"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c\") " pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:52.907229 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:52.907209 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b08b35_7081_421c_9bca_38c58e5e99e8.slice/crio-88858445efe4131e7746b09978f822c1dbc129c20fe5bee3698e9a23c4768515 WatchSource:0}: Error finding container 88858445efe4131e7746b09978f822c1dbc129c20fe5bee3698e9a23c4768515: Status 404 returned error can't find the container with id 88858445efe4131e7746b09978f822c1dbc129c20fe5bee3698e9a23c4768515 Jul 06 17:52:53.050550 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.050518 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvljr\"" Jul 06 17:52:53.058716 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.058698 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:53.212945 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.212921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nkqz2"] Jul 06 17:52:53.215366 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:53.215336 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e76ef4b_8b1c_4a9b_b6f6_1302a7303a3c.slice/crio-c9848269d9c0c654f8ed215364f76585ddb6dc274fe33d5d6f74c8fed7340bbf WatchSource:0}: Error finding container c9848269d9c0c654f8ed215364f76585ddb6dc274fe33d5d6f74c8fed7340bbf: Status 404 returned error can't find the container with id c9848269d9c0c654f8ed215364f76585ddb6dc274fe33d5d6f74c8fed7340bbf Jul 06 17:52:53.226643 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.226603 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btjc4_8f349735-c7e1-4da6-8fdd-f187d5414b53/node-ca/0.log" Jul 06 17:52:53.292841 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.292804 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nkqz2" event={"ID":"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c","Type":"ContainerStarted","Data":"c9848269d9c0c654f8ed215364f76585ddb6dc274fe33d5d6f74c8fed7340bbf"} Jul 06 17:52:53.293975 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:53.293953 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfv8j" event={"ID":"87b08b35-7081-421c-9bca-38c58e5e99e8","Type":"ContainerStarted","Data":"88858445efe4131e7746b09978f822c1dbc129c20fe5bee3698e9a23c4768515"} Jul 06 17:52:54.290191 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.290150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:52:54.290392 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.290241 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:54.290392 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.290272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:54.290392 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290349 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:54.290392 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290362 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:54.290631 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290395 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:54.290631 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290451 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:02.290411574 +0000 UTC m=+75.778938656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:52:54.290631 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290479 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:58.290460375 +0000 UTC m=+71.778987462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:54.290631 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:54.290500 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:52:58.290489361 +0000 UTC m=+71.779016449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : configmap "kube-rbac-proxy" not found Jul 06 17:52:54.427219 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.427188 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jzsx2_073b3339-f45e-4835-a8a7-c57f39360b4f/serve-healthcheck-canary/0.log" Jul 06 17:52:54.515461 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.515409 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5"] Jul 06 17:52:54.517166 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.517151 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.520529 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.520508 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 17:52:54.520932 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.520913 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 17:52:54.521017 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.521002 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:52:54.521559 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.521544 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4cjb2\"" Jul 06 17:52:54.521612 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.521579 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 17:52:54.532324 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.532306 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5"] Jul 06 17:52:54.592177 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.592107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/668a7758-f76a-4fff-954b-9bc33ff6c8d9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.592177 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.592137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwjf\" (UniqueName: \"kubernetes.io/projected/668a7758-f76a-4fff-954b-9bc33ff6c8d9-kube-api-access-llwjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.592341 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.592206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/668a7758-f76a-4fff-954b-9bc33ff6c8d9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.692622 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.692588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/668a7758-f76a-4fff-954b-9bc33ff6c8d9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.692622 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.692634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llwjf\" (UniqueName: \"kubernetes.io/projected/668a7758-f76a-4fff-954b-9bc33ff6c8d9-kube-api-access-llwjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.692980 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.692730 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/668a7758-f76a-4fff-954b-9bc33ff6c8d9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.693256 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.693226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/668a7758-f76a-4fff-954b-9bc33ff6c8d9-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.695191 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.695166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/668a7758-f76a-4fff-954b-9bc33ff6c8d9-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.702545 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.702521 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwjf\" (UniqueName: \"kubernetes.io/projected/668a7758-f76a-4fff-954b-9bc33ff6c8d9-kube-api-access-llwjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-2w2v5\" (UID: \"668a7758-f76a-4fff-954b-9bc33ff6c8d9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.826208 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.826176 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" Jul 06 17:52:54.964918 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:54.964885 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5"] Jul 06 17:52:54.968671 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:54.968641 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668a7758_f76a_4fff_954b_9bc33ff6c8d9.slice/crio-dc08d75594dbd71e4e334e1da5351e3820d9fafc4a1f3f2c9d3bc1347a99e479 WatchSource:0}: Error finding container dc08d75594dbd71e4e334e1da5351e3820d9fafc4a1f3f2c9d3bc1347a99e479: Status 404 returned error can't find the container with id dc08d75594dbd71e4e334e1da5351e3820d9fafc4a1f3f2c9d3bc1347a99e479 Jul 06 17:52:55.300723 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:55.300650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" event={"ID":"668a7758-f76a-4fff-954b-9bc33ff6c8d9","Type":"ContainerStarted","Data":"dc08d75594dbd71e4e334e1da5351e3820d9fafc4a1f3f2c9d3bc1347a99e479"} Jul 06 17:52:56.485834 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.485804 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss"] Jul 06 17:52:56.487906 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.487884 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.491032 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.491008 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 17:52:56.491147 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.491069 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xsrhs\"" Jul 06 17:52:56.491856 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.491807 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 17:52:56.491856 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.491833 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:52:56.491856 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.491843 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 17:52:56.504241 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.504195 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss"] Jul 06 17:52:56.507537 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.507509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2ts9\" (UniqueName: \"kubernetes.io/projected/d2983798-4872-4cf4-acb0-917cce4269cc-kube-api-access-h2ts9\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.507634 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.507554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2983798-4872-4cf4-acb0-917cce4269cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.507634 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.507612 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2983798-4872-4cf4-acb0-917cce4269cc-config\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.608412 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.608381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2983798-4872-4cf4-acb0-917cce4269cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.608589 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.608454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2983798-4872-4cf4-acb0-917cce4269cc-config\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.608791 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.608739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2ts9\" (UniqueName: \"kubernetes.io/projected/d2983798-4872-4cf4-acb0-917cce4269cc-kube-api-access-h2ts9\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.609062 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.609037 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2983798-4872-4cf4-acb0-917cce4269cc-config\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.611213 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.611188 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2983798-4872-4cf4-acb0-917cce4269cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.618563 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.618539 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2ts9\" (UniqueName: \"kubernetes.io/projected/d2983798-4872-4cf4-acb0-917cce4269cc-kube-api-access-h2ts9\") pod \"service-ca-operator-5d46d9ffd4-78sss\" (UID: \"d2983798-4872-4cf4-acb0-917cce4269cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:56.798802 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:56.798759 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" Jul 06 17:52:57.314561 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:57.314531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:52:57.314751 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:57.314659 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:57.314821 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:57.314769 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls podName:dc1f1c95-c108-4e5e-b13b-6273cd0ac82e nodeName:}" failed. No retries permitted until 2026-07-06 17:53:29.314746951 +0000 UTC m=+102.803274033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls") pod "dns-default-4tpbk" (UID: "dc1f1c95-c108-4e5e-b13b-6273cd0ac82e") : secret "dns-default-metrics-tls" not found Jul 06 17:52:58.321761 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:58.321722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:58.322156 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:58.321772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:52:58.322156 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:58.321884 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:58.322156 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:58.321901 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:58.322156 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:58.321943 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:53:06.321924998 +0000 UTC m=+79.810452088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : configmap "kube-rbac-proxy" not found Jul 06 17:52:58.322156 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:52:58.321977 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:53:06.321960079 +0000 UTC m=+79.810487161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:58.703725 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:58.703633 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss"] Jul 06 17:52:58.706019 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:58.705994 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2983798_4872_4cf4_acb0_917cce4269cc.slice/crio-3a6448657decebb01287b8a3df0b92713ca4472d7ab10f41e97856ab5c787625 WatchSource:0}: Error finding container 3a6448657decebb01287b8a3df0b92713ca4472d7ab10f41e97856ab5c787625: Status 404 returned error can't find the container with id 3a6448657decebb01287b8a3df0b92713ca4472d7ab10f41e97856ab5c787625 Jul 06 17:52:59.311267 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.311234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" event={"ID":"d2983798-4872-4cf4-acb0-917cce4269cc","Type":"ContainerStarted","Data":"3a6448657decebb01287b8a3df0b92713ca4472d7ab10f41e97856ab5c787625"} Jul 06 17:52:59.312748 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.312717 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfv8j" event={"ID":"87b08b35-7081-421c-9bca-38c58e5e99e8","Type":"ContainerStarted","Data":"1f96e4f810657d7716fe51b232fd5a0645c80f893331bb94e88bcbcde3e254a5"} Jul 06 17:52:59.314240 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.314214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" event={"ID":"668a7758-f76a-4fff-954b-9bc33ff6c8d9","Type":"ContainerStarted","Data":"9a63b970016283099bc4cbba197814884b072595c692cbbe87a70ef75fe00032"} Jul 06 17:52:59.315679 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.315646 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nkqz2" event={"ID":"6e76ef4b-8b1c-4a9b-b6f6-1302a7303a3c","Type":"ContainerStarted","Data":"1bb17678fd14883376e9fa5c67a6681ac596002b525685f40826e1ac5a2fe5b9"} Jul 06 17:52:59.315828 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.315807 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:52:59.330735 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.330685 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zfv8j" podStartSLOduration=66.680202058 podStartE2EDuration="1m12.330667943s" totalImagesPullingTime="5.650465885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:59.329835188 +0000 UTC m=+72.818362292" watchObservedRunningTime="2026-07-06 17:52:59.330667943 +0000 UTC m=+72.819195056" Jul 06 17:52:59.367916 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.367856 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nkqz2" podStartSLOduration=67.01917426 podStartE2EDuration="1m12.36783381s" totalImagesPullingTime="5.34865955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:59.349750313 +0000 UTC m=+72.838277418" watchObservedRunningTime="2026-07-06 17:52:59.36783381 +0000 UTC m=+72.856360915" Jul 06 17:52:59.368443 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.368396 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" podStartSLOduration=1.772717064 podStartE2EDuration="5.368387929s" totalImagesPullingTime="3.595670865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:59.367354513 +0000 UTC m=+72.855881618" watchObservedRunningTime="2026-07-06 17:52:59.368387929 +0000 UTC m=+72.856915034" Jul 06 17:52:59.463211 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.463170 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk"] Jul 06 17:52:59.465258 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.465235 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" Jul 06 17:52:59.468375 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.468357 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 17:52:59.468603 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.468576 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 17:52:59.468831 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.468815 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rzrsp\"" Jul 06 17:52:59.483326 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.483304 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk"] Jul 06 17:52:59.533254 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.533223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjkp5\" (UniqueName: \"kubernetes.io/projected/992cc03f-93f0-49c1-8027-384842b00e23-kube-api-access-tjkp5\") pod \"migrator-d57d58cc9-j2xpk\" (UID: \"992cc03f-93f0-49c1-8027-384842b00e23\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" Jul 06 17:52:59.634646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.634581 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjkp5\" (UniqueName: \"kubernetes.io/projected/992cc03f-93f0-49c1-8027-384842b00e23-kube-api-access-tjkp5\") pod \"migrator-d57d58cc9-j2xpk\" (UID: \"992cc03f-93f0-49c1-8027-384842b00e23\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" Jul 06 17:52:59.643887 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.643862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjkp5\" (UniqueName: \"kubernetes.io/projected/992cc03f-93f0-49c1-8027-384842b00e23-kube-api-access-tjkp5\") pod \"migrator-d57d58cc9-j2xpk\" (UID: \"992cc03f-93f0-49c1-8027-384842b00e23\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" Jul 06 17:52:59.775232 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.775196 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" Jul 06 17:52:59.910966 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:52:59.910883 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk"] Jul 06 17:52:59.913746 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:52:59.913714 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992cc03f_93f0_49c1_8027_384842b00e23.slice/crio-b635d03c6e4f64c6c5ab50b511461cff8aedc220ca92fc82d365d477fc222926 WatchSource:0}: Error finding container b635d03c6e4f64c6c5ab50b511461cff8aedc220ca92fc82d365d477fc222926: Status 404 returned error can't find the container with id b635d03c6e4f64c6c5ab50b511461cff8aedc220ca92fc82d365d477fc222926 Jul 06 17:53:00.319520 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:00.319483 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" event={"ID":"992cc03f-93f0-49c1-8027-384842b00e23","Type":"ContainerStarted","Data":"b635d03c6e4f64c6c5ab50b511461cff8aedc220ca92fc82d365d477fc222926"} Jul 06 17:53:02.327357 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.327320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" event={"ID":"d2983798-4872-4cf4-acb0-917cce4269cc","Type":"ContainerStarted","Data":"bdca8ec61cd99d18504ff291872b31ebe52c2dba3723d013d2eb44ad909a9535"} Jul 06 17:53:02.329070 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.329046 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" event={"ID":"992cc03f-93f0-49c1-8027-384842b00e23","Type":"ContainerStarted","Data":"1fba82bf3c8d217f68704d698799883bd42f25347884b7b82e6c00b48f677216"} Jul 06 17:53:02.329195 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.329092 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" event={"ID":"992cc03f-93f0-49c1-8027-384842b00e23","Type":"ContainerStarted","Data":"c95b6c125b12443566accea0b332acb7755ce43b27a577ef4235e6ed85440006"} Jul 06 17:53:02.346368 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.346326 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" podStartSLOduration=3.256580487 podStartE2EDuration="6.346313324s" totalImagesPullingTime="3.089732837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:02.344818362 +0000 UTC m=+75.833345466" watchObservedRunningTime="2026-07-06 17:53:02.346313324 +0000 UTC m=+75.834840427" Jul 06 17:53:02.354343 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.354307 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:53:02.354487 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:02.354471 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:53:02.354558 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:02.354533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls podName:6a684cf9-de28-4f55-b6fd-bf14e2888558 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:18.354513348 +0000 UTC m=+91.843040430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9lcj" (UID: "6a684cf9-de28-4f55-b6fd-bf14e2888558") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:53:02.361857 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:02.361819 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2xpk" podStartSLOduration=1.479431719 podStartE2EDuration="3.361804829s" totalImagesPullingTime="1.88237311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:02.360872838 +0000 UTC m=+75.849399942" watchObservedRunningTime="2026-07-06 17:53:02.361804829 +0000 UTC m=+75.850331932" Jul 06 17:53:05.252029 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.250468 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q7vnp"] Jul 06 17:53:05.254600 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.254571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.257471 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.257448 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 17:53:05.258461 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.258446 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 17:53:05.258539 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.258475 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sxntj\"" Jul 06 17:53:05.258629 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.258613 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 17:53:05.258675 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.258667 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 17:53:05.261675 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.261654 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q7vnp"] Jul 06 17:53:05.374895 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.374863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4lj7\" (UniqueName: \"kubernetes.io/projected/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-kube-api-access-r4lj7\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.374895 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.374901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-cabundle\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.375157 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.374935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-key\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.475513 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.475474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4lj7\" (UniqueName: \"kubernetes.io/projected/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-kube-api-access-r4lj7\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.475706 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.475524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-cabundle\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.475775 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.475702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-key\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.476114 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.476096 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-cabundle\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.477962 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.477941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-signing-key\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.484024 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.483996 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4lj7\" (UniqueName: \"kubernetes.io/projected/1c9bdeb5-372d-4e00-9922-1fe0a4754f54-kube-api-access-r4lj7\") pod \"service-ca-758f599c5-q7vnp\" (UID: \"1c9bdeb5-372d-4e00-9922-1fe0a4754f54\") " pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.564087 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.564007 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-q7vnp" Jul 06 17:53:05.689820 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:05.689785 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q7vnp"] Jul 06 17:53:05.692628 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:05.692603 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9bdeb5_372d_4e00_9922_1fe0a4754f54.slice/crio-bdee40972a8295e7e370255a8e01606e5896c9d2f52ba7b14e0df6ca7d1a4ee4 WatchSource:0}: Error finding container bdee40972a8295e7e370255a8e01606e5896c9d2f52ba7b14e0df6ca7d1a4ee4: Status 404 returned error can't find the container with id bdee40972a8295e7e370255a8e01606e5896c9d2f52ba7b14e0df6ca7d1a4ee4 Jul 06 17:53:06.344473 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.344412 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-q7vnp" event={"ID":"1c9bdeb5-372d-4e00-9922-1fe0a4754f54","Type":"ContainerStarted","Data":"8995fc2d59e404f88849db4652b8120af3951e0f31e1c5854b398fd50e9aaf04"} Jul 06 17:53:06.344879 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.344500 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-q7vnp" event={"ID":"1c9bdeb5-372d-4e00-9922-1fe0a4754f54","Type":"ContainerStarted","Data":"bdee40972a8295e7e370255a8e01606e5896c9d2f52ba7b14e0df6ca7d1a4ee4"} Jul 06 17:53:06.363585 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.363533 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-q7vnp" podStartSLOduration=1.36351933 podStartE2EDuration="1.36351933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:06.362376874 +0000 UTC m=+79.850903979" watchObservedRunningTime="2026-07-06 17:53:06.36351933 +0000 UTC m=+79.852046434" Jul 06 17:53:06.384040 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.384010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:06.384140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.384058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:06.384199 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:06.384153 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:53:06.384255 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:06.384232 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls podName:cb8769a4-8722-40b6-a739-47f87f88cf3a nodeName:}" failed. No retries permitted until 2026-07-06 17:53:22.384212579 +0000 UTC m=+95.872739661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fntcq" (UID: "cb8769a4-8722-40b6-a739-47f87f88cf3a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:53:06.384717 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:06.384694 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb8769a4-8722-40b6-a739-47f87f88cf3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:18.374021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:18.373893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:53:18.376161 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:18.376139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a684cf9-de28-4f55-b6fd-bf14e2888558-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9lcj\" (UID: \"6a684cf9-de28-4f55-b6fd-bf14e2888558\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:53:18.655104 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:18.655025 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p7vm7\"" Jul 06 17:53:18.661492 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:18.661475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" Jul 06 17:53:18.792750 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:18.792729 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj"] Jul 06 17:53:18.794614 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:18.794588 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a684cf9_de28_4f55_b6fd_bf14e2888558.slice/crio-36133a84944f2383d2bd2d4b7569db3c89b1b4cbb3d9254d4ebf82993973cdd1 WatchSource:0}: Error finding container 36133a84944f2383d2bd2d4b7569db3c89b1b4cbb3d9254d4ebf82993973cdd1: Status 404 returned error can't find the container with id 36133a84944f2383d2bd2d4b7569db3c89b1b4cbb3d9254d4ebf82993973cdd1 Jul 06 17:53:19.386491 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:19.386460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" event={"ID":"6a684cf9-de28-4f55-b6fd-bf14e2888558","Type":"ContainerStarted","Data":"36133a84944f2383d2bd2d4b7569db3c89b1b4cbb3d9254d4ebf82993973cdd1"} Jul 06 17:53:21.394136 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:21.394089 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" event={"ID":"6a684cf9-de28-4f55-b6fd-bf14e2888558","Type":"ContainerStarted","Data":"520a0431422fdb9cc6d5bef86c545745f8cf327a600af09daac3900850bd7e17"} Jul 06 17:53:21.414604 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:21.414547 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9lcj" podStartSLOduration=33.232708656 podStartE2EDuration="35.41452754s" totalImagesPullingTime="2.181818884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:21.413335946 +0000 UTC m=+94.901863051" watchObservedRunningTime="2026-07-06 17:53:21.41452754 +0000 UTC m=+94.903054639" Jul 06 17:53:22.407254 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:22.407224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:22.409489 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:22.409470 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb8769a4-8722-40b6-a739-47f87f88cf3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fntcq\" (UID: \"cb8769a4-8722-40b6-a739-47f87f88cf3a\") " pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:22.444461 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:22.444434 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fntcq" Jul 06 17:53:22.567945 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:22.567906 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fntcq"] Jul 06 17:53:22.570828 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:22.570793 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8769a4_8722_40b6_a739_47f87f88cf3a.slice/crio-c7aae5030a9506cdab2d9e247c115070a65b12ff8c164b730b53336896fa1e7a WatchSource:0}: Error finding container c7aae5030a9506cdab2d9e247c115070a65b12ff8c164b730b53336896fa1e7a: Status 404 returned error can't find the container with id c7aae5030a9506cdab2d9e247c115070a65b12ff8c164b730b53336896fa1e7a Jul 06 17:53:23.403207 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:23.403102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fntcq" event={"ID":"cb8769a4-8722-40b6-a739-47f87f88cf3a","Type":"ContainerStarted","Data":"c7aae5030a9506cdab2d9e247c115070a65b12ff8c164b730b53336896fa1e7a"} Jul 06 17:53:26.414791 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:26.414761 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fntcq" event={"ID":"cb8769a4-8722-40b6-a739-47f87f88cf3a","Type":"ContainerStarted","Data":"698511bed5adb341228a01990a264c61193a0ba6a53c410c4bb8921b55abada7"} Jul 06 17:53:27.422242 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:27.422201 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fntcq" event={"ID":"cb8769a4-8722-40b6-a739-47f87f88cf3a","Type":"ContainerStarted","Data":"89e5baed8ccc4eee614a7706340828dd3e93d2e01a63c779c192d5a8906d568c"} Jul 06 17:53:29.366319 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.366294 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:53:29.368258 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.368238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f1c95-c108-4e5e-b13b-6273cd0ac82e-metrics-tls\") pod \"dns-default-4tpbk\" (UID: \"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e\") " pod="openshift-dns/dns-default-4tpbk" Jul 06 17:53:29.430583 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.430551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fntcq" event={"ID":"cb8769a4-8722-40b6-a739-47f87f88cf3a","Type":"ContainerStarted","Data":"5f6ba4af5cd866d898a871b341a5a8db1b07dbede9a042387e82082ba5549a32"} Jul 06 17:53:29.457296 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.457248 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fntcq" podStartSLOduration=32.811670938 podStartE2EDuration="39.457232901s" totalImagesPullingTime="6.645561963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:52:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:29.455545447 +0000 UTC m=+102.944072551" watchObservedRunningTime="2026-07-06 17:53:29.457232901 +0000 UTC m=+102.945760003" Jul 06 17:53:29.651179 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.651102 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8pm\"" Jul 06 17:53:29.657205 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.657188 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tpbk" Jul 06 17:53:29.790174 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.790140 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tpbk"] Jul 06 17:53:29.793070 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:29.793043 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1f1c95_c108_4e5e_b13b_6273cd0ac82e.slice/crio-c9aa77c5422e8100737f7f5bf7aa75efbefb452f967e54a8de8a1ae29f6170b6 WatchSource:0}: Error finding container c9aa77c5422e8100737f7f5bf7aa75efbefb452f967e54a8de8a1ae29f6170b6: Status 404 returned error can't find the container with id c9aa77c5422e8100737f7f5bf7aa75efbefb452f967e54a8de8a1ae29f6170b6 Jul 06 17:53:29.867858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.867823 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt"] Jul 06 17:53:29.872107 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.872086 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg"] Jul 06 17:53:29.872235 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.872206 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:29.874896 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.874880 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:29.877440 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.877400 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 17:53:29.878632 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.878593 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6flcw\"" Jul 06 17:53:29.879005 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.878987 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 17:53:29.886445 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.886409 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 17:53:29.886538 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.886525 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m7jpd\"" Jul 06 17:53:29.887656 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.887638 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 17:53:29.887754 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.887663 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 17:53:29.889761 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.889743 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt"] Jul 06 17:53:29.892983 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.892962 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg"] Jul 06 17:53:29.951878 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.951799 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bbc86d56-v5pgx"] Jul 06 17:53:29.954806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.954787 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:29.960206 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.960187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 17:53:29.960596 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.960520 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 17:53:29.960857 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.960827 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-74rbm\"" Jul 06 17:53:29.961099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.961042 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 17:53:29.970318 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.970291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8868c174-b518-4021-91da-792e80e04c1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:29.970476 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.970323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzwf\" (UniqueName: \"kubernetes.io/projected/8868c174-b518-4021-91da-792e80e04c1e-kube-api-access-tmzwf\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:29.970476 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.970348 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd76f6f3-d506-404c-ad36-ac27d2371eeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-64dvt\" (UID: \"cd76f6f3-d506-404c-ad36-ac27d2371eeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:29.970610 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.970576 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 17:53:29.984241 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:29.984215 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbc86d56-v5pgx"] Jul 06 17:53:30.071686 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-bound-sa-token\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.071890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-installation-pull-secrets\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.071890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-image-registry-private-configuration\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.071890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071764 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1d24cf-3f6f-4816-ac67-7a236b369178-ca-trust-extracted\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.071890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071781 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-trusted-ca\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.071890 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-certificates\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.072140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8868c174-b518-4021-91da-792e80e04c1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:30.072140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzwf\" (UniqueName: \"kubernetes.io/projected/8868c174-b518-4021-91da-792e80e04c1e-kube-api-access-tmzwf\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:30.072140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.071956 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzkfq\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-kube-api-access-zzkfq\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.072140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.072003 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd76f6f3-d506-404c-ad36-ac27d2371eeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-64dvt\" (UID: \"cd76f6f3-d506-404c-ad36-ac27d2371eeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:30.072140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.072053 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-tls\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.074385 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.074362 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd76f6f3-d506-404c-ad36-ac27d2371eeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-64dvt\" (UID: \"cd76f6f3-d506-404c-ad36-ac27d2371eeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:30.074385 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.074383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8868c174-b518-4021-91da-792e80e04c1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:30.093988 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.093958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzwf\" (UniqueName: \"kubernetes.io/projected/8868c174-b518-4021-91da-792e80e04c1e-kube-api-access-tmzwf\") pod \"managed-serviceaccount-addon-agent-5cff57d96b-qjtpg\" (UID: \"8868c174-b518-4021-91da-792e80e04c1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:30.172783 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-bound-sa-token\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-installation-pull-secrets\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-image-registry-private-configuration\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1d24cf-3f6f-4816-ac67-7a236b369178-ca-trust-extracted\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-trusted-ca\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172919 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-certificates\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.172950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.172949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzkfq\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-kube-api-access-zzkfq\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.173215 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.173005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-tls\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.173338 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.173306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e1d24cf-3f6f-4816-ac67-7a236b369178-ca-trust-extracted\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.174021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.173994 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-certificates\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.174116 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.174001 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e1d24cf-3f6f-4816-ac67-7a236b369178-trusted-ca\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.175507 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.175487 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-image-registry-private-configuration\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.175610 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.175576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e1d24cf-3f6f-4816-ac67-7a236b369178-installation-pull-secrets\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.175679 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.175664 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-registry-tls\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.182434 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.182403 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:30.195694 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.195670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzkfq\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-kube-api-access-zzkfq\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.195779 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.195671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e1d24cf-3f6f-4816-ac67-7a236b369178-bound-sa-token\") pod \"image-registry-6bbc86d56-v5pgx\" (UID: \"9e1d24cf-3f6f-4816-ac67-7a236b369178\") " pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.197357 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.197337 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" Jul 06 17:53:30.263462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.263407 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:30.323479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.323189 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nkqz2" Jul 06 17:53:30.349393 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.349357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt"] Jul 06 17:53:30.352924 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:30.352901 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd76f6f3_d506_404c_ad36_ac27d2371eeb.slice/crio-8444b3b6eff77732dd96a61a99d29d4ce1e8bb3d57d45d0f680d7d866aa5b4b5 WatchSource:0}: Error finding container 8444b3b6eff77732dd96a61a99d29d4ce1e8bb3d57d45d0f680d7d866aa5b4b5: Status 404 returned error can't find the container with id 8444b3b6eff77732dd96a61a99d29d4ce1e8bb3d57d45d0f680d7d866aa5b4b5 Jul 06 17:53:30.390782 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.390749 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg"] Jul 06 17:53:30.393630 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:30.393603 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8868c174_b518_4021_91da_792e80e04c1e.slice/crio-c09d03785cbd7a228336d4faee1a8808c37042b39b4ab0be0c70b56ddbdf31ee WatchSource:0}: Error finding container c09d03785cbd7a228336d4faee1a8808c37042b39b4ab0be0c70b56ddbdf31ee: Status 404 returned error can't find the container with id c09d03785cbd7a228336d4faee1a8808c37042b39b4ab0be0c70b56ddbdf31ee Jul 06 17:53:30.435123 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.435087 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tpbk" event={"ID":"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e","Type":"ContainerStarted","Data":"c9aa77c5422e8100737f7f5bf7aa75efbefb452f967e54a8de8a1ae29f6170b6"} Jul 06 17:53:30.436243 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.436218 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" event={"ID":"cd76f6f3-d506-404c-ad36-ac27d2371eeb","Type":"ContainerStarted","Data":"8444b3b6eff77732dd96a61a99d29d4ce1e8bb3d57d45d0f680d7d866aa5b4b5"} Jul 06 17:53:30.437231 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.437208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" event={"ID":"8868c174-b518-4021-91da-792e80e04c1e","Type":"ContainerStarted","Data":"c09d03785cbd7a228336d4faee1a8808c37042b39b4ab0be0c70b56ddbdf31ee"} Jul 06 17:53:30.455406 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:30.455384 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbc86d56-v5pgx"] Jul 06 17:53:30.455963 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:30.455944 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1d24cf_3f6f_4816_ac67_7a236b369178.slice/crio-c3c562957e5e37b6caae202f416f8ca1f056208b9a82c04a3dcb6e68bd534305 WatchSource:0}: Error finding container c3c562957e5e37b6caae202f416f8ca1f056208b9a82c04a3dcb6e68bd534305: Status 404 returned error can't find the container with id c3c562957e5e37b6caae202f416f8ca1f056208b9a82c04a3dcb6e68bd534305 Jul 06 17:53:31.446908 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:31.446621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" event={"ID":"9e1d24cf-3f6f-4816-ac67-7a236b369178","Type":"ContainerStarted","Data":"def2d7421af81427c4ba4c19bbad743218f8621b4225b61c92927174b03f8f61"} Jul 06 17:53:31.446908 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:31.446682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" event={"ID":"9e1d24cf-3f6f-4816-ac67-7a236b369178","Type":"ContainerStarted","Data":"c3c562957e5e37b6caae202f416f8ca1f056208b9a82c04a3dcb6e68bd534305"} Jul 06 17:53:31.446908 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:31.446721 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:31.472967 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:31.472217 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" podStartSLOduration=2.472198148 podStartE2EDuration="2.472198148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:31.471394935 +0000 UTC m=+104.959922039" watchObservedRunningTime="2026-07-06 17:53:31.472198148 +0000 UTC m=+104.960725230" Jul 06 17:53:34.460161 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.459514 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tpbk" event={"ID":"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e","Type":"ContainerStarted","Data":"b22a5c2ccf0df241d1b8ef767d8ab823f9b863b338810db3adeacdd2d88283fc"} Jul 06 17:53:34.460161 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.459580 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tpbk" event={"ID":"dc1f1c95-c108-4e5e-b13b-6273cd0ac82e","Type":"ContainerStarted","Data":"9b683230359524a74baed39ca8cb100cc90ee056c88d9c915456f150e8513e10"} Jul 06 17:53:34.460739 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.460235 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4tpbk" Jul 06 17:53:34.462108 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.462079 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" event={"ID":"cd76f6f3-d506-404c-ad36-ac27d2371eeb","Type":"ContainerStarted","Data":"562a02991ec44be136aa2f49a5f9b1e67b6a20abe430af01438f326545eff703"} Jul 06 17:53:34.462251 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.462223 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:34.463875 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.463849 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" event={"ID":"8868c174-b518-4021-91da-792e80e04c1e","Type":"ContainerStarted","Data":"1b5a3bc3b01aa768483e7a62dc0f699313c446e63af6df6723ab764bb25dc6f5"} Jul 06 17:53:34.467025 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.467002 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" Jul 06 17:53:34.481443 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.481392 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4tpbk" podStartSLOduration=65.238899603 podStartE2EDuration="1m9.481380451s" totalImagesPullingTime="4.242480848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:34.480262235 +0000 UTC m=+107.968789339" watchObservedRunningTime="2026-07-06 17:53:34.481380451 +0000 UTC m=+107.969907565" Jul 06 17:53:34.497808 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.497768 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-64dvt" podStartSLOduration=1.820289432 podStartE2EDuration="5.497756872s" totalImagesPullingTime="3.67746744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:34.497068001 +0000 UTC m=+107.985595106" watchObservedRunningTime="2026-07-06 17:53:34.497756872 +0000 UTC m=+107.986283975" Jul 06 17:53:34.517705 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:34.517661 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cff57d96b-qjtpg" podStartSLOduration=1.612338337 podStartE2EDuration="5.517645474s" totalImagesPullingTime="3.905307137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:34.517376433 +0000 UTC m=+108.005903537" watchObservedRunningTime="2026-07-06 17:53:34.517645474 +0000 UTC m=+108.006172579" Jul 06 17:53:38.893346 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.893308 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-qh72c"] Jul 06 17:53:38.895545 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.895525 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:53:38.914297 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.914275 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 17:53:38.914415 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.914308 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nnr6m\"" Jul 06 17:53:38.924793 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.924773 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 17:53:38.936086 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:38.936049 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qh72c"] Jul 06 17:53:39.042518 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.042491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvvv\" (UniqueName: \"kubernetes.io/projected/8e681b1e-2ee2-4674-b19c-d27f1c0152c8-kube-api-access-zwvvv\") pod \"downloads-685bfb5f64-qh72c\" (UID: \"8e681b1e-2ee2-4674-b19c-d27f1c0152c8\") " pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:53:39.143346 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.143310 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvvv\" (UniqueName: \"kubernetes.io/projected/8e681b1e-2ee2-4674-b19c-d27f1c0152c8-kube-api-access-zwvvv\") pod \"downloads-685bfb5f64-qh72c\" (UID: \"8e681b1e-2ee2-4674-b19c-d27f1c0152c8\") " pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:53:39.154856 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.154786 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvvv\" (UniqueName: \"kubernetes.io/projected/8e681b1e-2ee2-4674-b19c-d27f1c0152c8-kube-api-access-zwvvv\") pod \"downloads-685bfb5f64-qh72c\" (UID: \"8e681b1e-2ee2-4674-b19c-d27f1c0152c8\") " pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:53:39.204575 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.204552 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:53:39.329965 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.329937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qh72c"] Jul 06 17:53:39.333291 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:39.333268 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e681b1e_2ee2_4674_b19c_d27f1c0152c8.slice/crio-6f6070a18cec1a7473a731cfb25bed8804c10c4545715fb886479ac0120ebac8 WatchSource:0}: Error finding container 6f6070a18cec1a7473a731cfb25bed8804c10c4545715fb886479ac0120ebac8: Status 404 returned error can't find the container with id 6f6070a18cec1a7473a731cfb25bed8804c10c4545715fb886479ac0120ebac8 Jul 06 17:53:39.479604 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:39.479519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qh72c" event={"ID":"8e681b1e-2ee2-4674-b19c-d27f1c0152c8","Type":"ContainerStarted","Data":"6f6070a18cec1a7473a731cfb25bed8804c10c4545715fb886479ac0120ebac8"} Jul 06 17:53:41.919918 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.919881 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx"] Jul 06 17:53:41.922364 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.922342 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:41.926395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.925946 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 17:53:41.926395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.926102 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 17:53:41.926395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.926181 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lp9mk\"" Jul 06 17:53:41.926395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.926372 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 17:53:41.937486 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.937455 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx"] Jul 06 17:53:41.947324 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.947304 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7"] Jul 06 17:53:41.949852 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.949834 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:41.952334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.952308 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 17:53:41.952959 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.952448 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 17:53:41.952959 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.952576 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cg9gr\"" Jul 06 17:53:41.952959 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.952751 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 17:53:41.968084 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.968063 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7"] Jul 06 17:53:41.981483 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.979196 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-748qg"] Jul 06 17:53:41.985610 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.985572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:41.988061 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.988044 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 17:53:41.989405 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.989388 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 17:53:41.989608 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.989570 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 17:53:41.989772 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:41.989474 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r4hp5\"" Jul 06 17:53:42.063902 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.063870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.064059 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.063909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.064059 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.063940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064059 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.063981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kkg\" (UniqueName: \"kubernetes.io/projected/60e4df9b-f276-4411-a9db-11125be67b30-kube-api-access-s6kkg\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.064059 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-metrics-client-ca\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064059 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064029 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbjt\" (UniqueName: \"kubernetes.io/projected/a4121f88-9661-4850-a5b8-ddec360adfdb-kube-api-access-7tbjt\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60e4df9b-f276-4411-a9db-11125be67b30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-root\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-sys\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkg8\" (UniqueName: \"kubernetes.io/projected/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-kube-api-access-rqkg8\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.064771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-wtmp\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.064771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064480 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-textfile\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.064771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.064513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kkg\" (UniqueName: \"kubernetes.io/projected/60e4df9b-f276-4411-a9db-11125be67b30-kube-api-access-s6kkg\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166153 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-metrics-client-ca\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166175 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbjt\" (UniqueName: \"kubernetes.io/projected/a4121f88-9661-4850-a5b8-ddec360adfdb-kube-api-access-7tbjt\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60e4df9b-f276-4411-a9db-11125be67b30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-root\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-sys\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkg8\" (UniqueName: \"kubernetes.io/projected/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-kube-api-access-rqkg8\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.169441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-wtmp\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-textfile\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.166571 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.166710 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.166780 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls podName:60e4df9b-f276-4411-a9db-11125be67b30 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:42.66676252 +0000 UTC m=+116.155289606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-phjm7" (UID: "60e4df9b-f276-4411-a9db-11125be67b30") : secret "kube-state-metrics-tls" not found Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.168553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-metrics-client-ca\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.169013 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.169147 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-wtmp\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.169220 2555 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.169265 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls podName:7b96e0c9-79d1-457c-ad02-a8c9eb1b5903 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:42.669248761 +0000 UTC m=+116.157775848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-2rgqx" (UID: "7b96e0c9-79d1-457c-ad02-a8c9eb1b5903") : secret "openshift-state-metrics-tls" not found Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.169786 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.169825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-textfile\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.170395 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.170371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.171120 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.170855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.171120 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.170944 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 17:53:42.171120 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.171000 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls podName:a4121f88-9661-4850-a5b8-ddec360adfdb nodeName:}" failed. No retries permitted until 2026-07-06 17:53:42.670983922 +0000 UTC m=+116.159511009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls") pod "node-exporter-748qg" (UID: "a4121f88-9661-4850-a5b8-ddec360adfdb") : secret "node-exporter-tls" not found Jul 06 17:53:42.171779 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.171642 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/60e4df9b-f276-4411-a9db-11125be67b30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.171779 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.171706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-root\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.171779 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.171757 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4121f88-9661-4850-a5b8-ddec360adfdb-sys\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.182092 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.182050 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.182729 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.182686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.185440 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.184675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.191064 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.190395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkg8\" (UniqueName: \"kubernetes.io/projected/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-kube-api-access-rqkg8\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.191064 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.190925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kkg\" (UniqueName: \"kubernetes.io/projected/60e4df9b-f276-4411-a9db-11125be67b30-kube-api-access-s6kkg\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.193408 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.193365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbjt\" (UniqueName: \"kubernetes.io/projected/a4121f88-9661-4850-a5b8-ddec360adfdb-kube-api-access-7tbjt\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.671939 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.671895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.672145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.671990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.672145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.672047 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:42.672243 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.672197 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 17:53:42.672283 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:53:42.672277 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls podName:60e4df9b-f276-4411-a9db-11125be67b30 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:43.672256422 +0000 UTC m=+117.160783508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-phjm7" (UID: "60e4df9b-f276-4411-a9db-11125be67b30") : secret "kube-state-metrics-tls" not found Jul 06 17:53:42.675112 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.675084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4121f88-9661-4850-a5b8-ddec360adfdb-node-exporter-tls\") pod \"node-exporter-748qg\" (UID: \"a4121f88-9661-4850-a5b8-ddec360adfdb\") " pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.675218 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.675087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b96e0c9-79d1-457c-ad02-a8c9eb1b5903-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2rgqx\" (UID: \"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.835537 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.835500 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" Jul 06 17:53:42.896635 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:42.896377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-748qg" Jul 06 17:53:42.922820 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:42.922318 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4121f88_9661_4850_a5b8_ddec360adfdb.slice/crio-f319a6ce5af0a808ec8ecb41e39db2990584b9414307594cfc06b8d1ed981027 WatchSource:0}: Error finding container f319a6ce5af0a808ec8ecb41e39db2990584b9414307594cfc06b8d1ed981027: Status 404 returned error can't find the container with id f319a6ce5af0a808ec8ecb41e39db2990584b9414307594cfc06b8d1ed981027 Jul 06 17:53:43.008079 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.008053 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx"] Jul 06 17:53:43.010600 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:43.010574 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b96e0c9_79d1_457c_ad02_a8c9eb1b5903.slice/crio-e00725463e975d47809f65079ff076229bc5c1aaea8ce0c85f2647bca41d1104 WatchSource:0}: Error finding container e00725463e975d47809f65079ff076229bc5c1aaea8ce0c85f2647bca41d1104: Status 404 returned error can't find the container with id e00725463e975d47809f65079ff076229bc5c1aaea8ce0c85f2647bca41d1104 Jul 06 17:53:43.497176 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.497122 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-748qg" event={"ID":"a4121f88-9661-4850-a5b8-ddec360adfdb","Type":"ContainerStarted","Data":"f319a6ce5af0a808ec8ecb41e39db2990584b9414307594cfc06b8d1ed981027"} Jul 06 17:53:43.500137 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.500007 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" event={"ID":"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903","Type":"ContainerStarted","Data":"1c65307a1cf4ae5a7dddd3ed5030a75af6f73722107ef2298be78646e2e5e5e3"} Jul 06 17:53:43.500137 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.500072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" event={"ID":"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903","Type":"ContainerStarted","Data":"5b4dd3d06be421e095aa44a8eb0b803df619ee4d68d6aae19b4debba45377deb"} Jul 06 17:53:43.500137 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.500100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" event={"ID":"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903","Type":"ContainerStarted","Data":"e00725463e975d47809f65079ff076229bc5c1aaea8ce0c85f2647bca41d1104"} Jul 06 17:53:43.681974 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.681940 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:43.684778 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.684748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60e4df9b-f276-4411-a9db-11125be67b30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-phjm7\" (UID: \"60e4df9b-f276-4411-a9db-11125be67b30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:43.758731 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:43.758697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" Jul 06 17:53:44.091786 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:44.091757 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7"] Jul 06 17:53:44.094614 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:44.094578 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e4df9b_f276_4411_a9db_11125be67b30.slice/crio-80b682377acfb58309eda72c98f1ffbed0764f09fc4a316e05e58b0fd3da9e6f WatchSource:0}: Error finding container 80b682377acfb58309eda72c98f1ffbed0764f09fc4a316e05e58b0fd3da9e6f: Status 404 returned error can't find the container with id 80b682377acfb58309eda72c98f1ffbed0764f09fc4a316e05e58b0fd3da9e6f Jul 06 17:53:44.469386 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:44.469001 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4tpbk" Jul 06 17:53:44.508541 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:44.507826 2555 generic.go:356] "Generic (PLEG): container finished" podID="a4121f88-9661-4850-a5b8-ddec360adfdb" containerID="d0f304928cf170ae366fc048eb87e22a78d8a8051a722b8337cfea596cc6ec05" exitCode=0 Jul 06 17:53:44.508541 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:44.507918 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-748qg" event={"ID":"a4121f88-9661-4850-a5b8-ddec360adfdb","Type":"ContainerDied","Data":"d0f304928cf170ae366fc048eb87e22a78d8a8051a722b8337cfea596cc6ec05"} Jul 06 17:53:44.510079 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:44.510009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" event={"ID":"60e4df9b-f276-4411-a9db-11125be67b30","Type":"ContainerStarted","Data":"80b682377acfb58309eda72c98f1ffbed0764f09fc4a316e05e58b0fd3da9e6f"} Jul 06 17:53:45.518099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:45.517803 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-748qg" event={"ID":"a4121f88-9661-4850-a5b8-ddec360adfdb","Type":"ContainerStarted","Data":"9c4fc482e2540726a6758da42ea160cef2df0afc73063d8892f67e6924a58601"} Jul 06 17:53:45.518099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:45.517903 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-748qg" event={"ID":"a4121f88-9661-4850-a5b8-ddec360adfdb","Type":"ContainerStarted","Data":"3f829c5e363a8683cf8f8df41c96716a6f1daa9319fe94147f9dab3fc71ce10a"} Jul 06 17:53:45.520910 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:45.520861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" event={"ID":"7b96e0c9-79d1-457c-ad02-a8c9eb1b5903","Type":"ContainerStarted","Data":"79caf777fb3a094c240a0c15a9f5086f81298d79ff895ecbf548de004b0a5f6f"} Jul 06 17:53:45.540954 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:45.540902 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-748qg" podStartSLOduration=3.406386827 podStartE2EDuration="4.540883248s" totalImagesPullingTime="1.05854586s" totalInitContainerRuntime="75.950561ms" isStatefulPod=true podCreationTimestamp="2026-07-06 17:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:45.539224351 +0000 UTC m=+119.027751456" watchObservedRunningTime="2026-07-06 17:53:45.540883248 +0000 UTC m=+119.029410353" Jul 06 17:53:45.558634 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:45.558582 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2rgqx" podStartSLOduration=2.98659593 podStartE2EDuration="4.558562334s" totalImagesPullingTime="1.571966404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:45.556945819 +0000 UTC m=+119.045472935" watchObservedRunningTime="2026-07-06 17:53:45.558562334 +0000 UTC m=+119.047089439" Jul 06 17:53:46.234204 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.234116 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-658799bb8d-zd9k8"] Jul 06 17:53:46.237766 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.237737 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.241492 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.241467 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 17:53:46.241795 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.241775 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ire7doup7a2n\"" Jul 06 17:53:46.241891 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.241779 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nvl2s\"" Jul 06 17:53:46.242036 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.242005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 17:53:46.242438 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.242232 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 17:53:46.242438 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.242362 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 17:53:46.248871 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.248847 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658799bb8d-zd9k8"] Jul 06 17:53:46.412643 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-audit-log\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjbl8\" (UniqueName: \"kubernetes.io/projected/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-kube-api-access-zjbl8\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-client-certs\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412754 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412775 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-client-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412806 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-metrics-server-audit-profiles\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.412994 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.412856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-tls\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.513837 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.513804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.513851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-client-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.513889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-metrics-server-audit-profiles\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.513918 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-tls\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514099 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.513958 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-audit-log\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514322 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.514099 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjbl8\" (UniqueName: \"kubernetes.io/projected/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-kube-api-access-zjbl8\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514322 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.514242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-client-certs\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514455 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.514410 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-audit-log\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.514785 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.514752 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.515032 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.515009 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-metrics-server-audit-profiles\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.517173 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.517150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-client-ca-bundle\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.517281 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.517155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-tls\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.517624 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.517603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-secret-metrics-server-client-certs\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.523721 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.523701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjbl8\" (UniqueName: \"kubernetes.io/projected/ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0-kube-api-access-zjbl8\") pod \"metrics-server-658799bb8d-zd9k8\" (UID: \"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0\") " pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.528966 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.528918 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" event={"ID":"60e4df9b-f276-4411-a9db-11125be67b30","Type":"ContainerStarted","Data":"1ee641aaa0d9baf7e714ce3d79b2c829c48f49e6e9b996d8f607a9c9a9072f15"} Jul 06 17:53:46.529094 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.528992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" event={"ID":"60e4df9b-f276-4411-a9db-11125be67b30","Type":"ContainerStarted","Data":"f82c6b9168a16368cbb2d4e3d3a576e054e7a3982879136deb8316e0c7888256"} Jul 06 17:53:46.529094 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.529022 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" event={"ID":"60e4df9b-f276-4411-a9db-11125be67b30","Type":"ContainerStarted","Data":"40a93fbded39318018cc741725c4a6960417ab1c6d4619c9439f2d1e58f2fb3f"} Jul 06 17:53:46.550343 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.550313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:53:46.554037 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.553903 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-phjm7" podStartSLOduration=3.863545225 podStartE2EDuration="5.553886738s" totalImagesPullingTime="1.690341513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:46.553279286 +0000 UTC m=+120.041806391" watchObservedRunningTime="2026-07-06 17:53:46.553886738 +0000 UTC m=+120.042413843" Jul 06 17:53:46.694952 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:46.694930 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658799bb8d-zd9k8"] Jul 06 17:53:46.697759 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:46.697734 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9083c8_72dd_4f5f_89d6_2bb4f3d5f7a0.slice/crio-7750743dd659203d9011d1ec4e1c6fda57ec6428b33a3a04a2898ced362048b8 WatchSource:0}: Error finding container 7750743dd659203d9011d1ec4e1c6fda57ec6428b33a3a04a2898ced362048b8: Status 404 returned error can't find the container with id 7750743dd659203d9011d1ec4e1c6fda57ec6428b33a3a04a2898ced362048b8 Jul 06 17:53:47.210749 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.210719 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-854b8bcbd6-vczr2"] Jul 06 17:53:47.214231 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.214205 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.216862 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.216841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 17:53:47.217001 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.216983 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 17:53:47.217706 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.217684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 17:53:47.217979 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.217933 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-htq7v\"" Jul 06 17:53:47.217979 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.217944 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 17:53:47.218131 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.218007 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 17:53:47.224457 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.224416 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 17:53:47.228054 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.228033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854b8bcbd6-vczr2"] Jul 06 17:53:47.322441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-serving-certs-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322620 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322620 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-federate-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322620 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-metrics-client-ca\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp828\" (UniqueName: \"kubernetes.io/projected/45e90218-1f03-4471-b0c4-fdf8f6b3712c-kube-api-access-pp828\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.322784 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.322753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.423993 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.423960 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-metrics-client-ca\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.423998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp828\" (UniqueName: \"kubernetes.io/projected/45e90218-1f03-4471-b0c4-fdf8f6b3712c-kube-api-access-pp828\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424027 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424291 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424160 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424291 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-serving-certs-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424406 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424376 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424490 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-federate-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.424901 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.424871 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-metrics-client-ca\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.425070 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.425048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-serving-certs-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.425311 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.425286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.426610 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.426581 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.426825 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.426807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.426825 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.426815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-telemeter-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.426917 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.426850 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45e90218-1f03-4471-b0c4-fdf8f6b3712c-federate-client-tls\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.432899 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.432874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp828\" (UniqueName: \"kubernetes.io/projected/45e90218-1f03-4471-b0c4-fdf8f6b3712c-kube-api-access-pp828\") pod \"telemeter-client-854b8bcbd6-vczr2\" (UID: \"45e90218-1f03-4471-b0c4-fdf8f6b3712c\") " pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.524876 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.524838 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" Jul 06 17:53:47.539592 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.539557 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" event={"ID":"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0","Type":"ContainerStarted","Data":"7750743dd659203d9011d1ec4e1c6fda57ec6428b33a3a04a2898ced362048b8"} Jul 06 17:53:47.701384 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:47.701293 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854b8bcbd6-vczr2"] Jul 06 17:53:47.703632 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:47.703599 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e90218_1f03_4471_b0c4_fdf8f6b3712c.slice/crio-a78dd4961f27ee2d161f1c50c0c6184c11234614c289faadbf6317f39b5d7403 WatchSource:0}: Error finding container a78dd4961f27ee2d161f1c50c0c6184c11234614c289faadbf6317f39b5d7403: Status 404 returned error can't find the container with id a78dd4961f27ee2d161f1c50c0c6184c11234614c289faadbf6317f39b5d7403 Jul 06 17:53:48.279447 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.278719 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:53:48.285002 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.284979 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.288780 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.288757 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rn3eksptk0hm\"" Jul 06 17:53:48.288919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.288798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 17:53:48.289131 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289110 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 17:53:48.289231 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289168 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 17:53:48.289297 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289251 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-79pmb\"" Jul 06 17:53:48.289355 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289315 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 17:53:48.289411 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289364 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 17:53:48.289478 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289441 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 17:53:48.289478 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 17:53:48.289762 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289739 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 17:53:48.289976 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 17:53:48.289976 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 17:53:48.289976 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.289857 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 17:53:48.290176 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.290123 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 17:53:48.290231 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.290183 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 17:53:48.292836 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.292812 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 17:53:48.300685 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.300663 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:53:48.333339 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333411 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333479 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4k5m\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333621 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333621 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333621 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333571 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333716 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333716 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333651 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333716 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333716 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.333858 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.334078 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.334078 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333973 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.334078 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.333998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.434902 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.434871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435103 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.434929 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435103 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435210 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435121 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435210 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435210 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435360 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435212 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435360 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435241 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435360 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435360 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435317 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435360 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435375 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4k5m\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435605 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.435646 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.436107 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.436107 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.435947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.436902 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.437286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.438030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.438069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.438267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.438462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.438788 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.438681 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.439266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.439245 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.439346 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.439326 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.439724 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.439662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.441512 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.441480 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.441941 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.441899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.442033 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.441934 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.442532 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.442486 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.442645 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.442622 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.443349 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.443324 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.443641 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.443622 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.443787 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.443766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.447601 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.447577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4k5m\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m\") pod \"prometheus-k8s-0\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.545109 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.545078 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" event={"ID":"45e90218-1f03-4471-b0c4-fdf8f6b3712c","Type":"ContainerStarted","Data":"a78dd4961f27ee2d161f1c50c0c6184c11234614c289faadbf6317f39b5d7403"} Jul 06 17:53:48.546941 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.546914 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" event={"ID":"ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0","Type":"ContainerStarted","Data":"8d3029bfb5e9b146f2462665780bb88bed97f7f7a2edd6fba1edd3ccbc0b5350"} Jul 06 17:53:48.566776 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.566723 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" podStartSLOduration=1.037883763 podStartE2EDuration="2.566704822s" totalImagesPullingTime="1.528821059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:48.565049002 +0000 UTC m=+122.053576107" watchObservedRunningTime="2026-07-06 17:53:48.566704822 +0000 UTC m=+122.055231928" Jul 06 17:53:48.602722 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.602697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:53:48.760659 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:48.760578 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:53:48.764400 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:53:48.764366 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8702880_7d50_4e85_ad17_143f38712a82.slice/crio-dea231afcec3dde54e52d2aff4ddc427429814f7a0381b59e47e736e400c3595 WatchSource:0}: Error finding container dea231afcec3dde54e52d2aff4ddc427429814f7a0381b59e47e736e400c3595: Status 404 returned error can't find the container with id dea231afcec3dde54e52d2aff4ddc427429814f7a0381b59e47e736e400c3595 Jul 06 17:53:49.554085 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:49.554035 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"dea231afcec3dde54e52d2aff4ddc427429814f7a0381b59e47e736e400c3595"} Jul 06 17:53:50.268956 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:50.268918 2555 patch_prober.go:28] interesting pod/image-registry-6bbc86d56-v5pgx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 17:53:50.269137 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:50.268979 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" podUID="9e1d24cf-3f6f-4816-ac67-7a236b369178" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:53:50.558492 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:50.558470 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="dd534e8e0cc49ef27319c855bf343ef59d1b21e96974dd4359da9408b0c393da" exitCode=0 Jul 06 17:53:50.558773 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:50.558535 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"dd534e8e0cc49ef27319c855bf343ef59d1b21e96974dd4359da9408b0c393da"} Jul 06 17:53:51.566414 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:51.566376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" event={"ID":"45e90218-1f03-4471-b0c4-fdf8f6b3712c","Type":"ContainerStarted","Data":"b15ddd06fe26d2c44701618322271e7dcbce0ccd1491ada384aaa771cb86572c"} Jul 06 17:53:51.566898 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:51.566465 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" event={"ID":"45e90218-1f03-4471-b0c4-fdf8f6b3712c","Type":"ContainerStarted","Data":"4a7909d9d1771fa7f29e0a76f536d7d8894282663f0ed213339e66a5e87d26b3"} Jul 06 17:53:51.566898 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:51.566498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" event={"ID":"45e90218-1f03-4471-b0c4-fdf8f6b3712c","Type":"ContainerStarted","Data":"22e5a4dea5d4c6cb4a17f0fdd66e45fe2c14dce3987d4f3ee9ee2fac4dd1c802"} Jul 06 17:53:51.595072 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:51.595014 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-854b8bcbd6-vczr2" podStartSLOduration=1.748786875 podStartE2EDuration="4.594992327s" totalImagesPullingTime="2.846205452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:51.59368616 +0000 UTC m=+125.082213267" watchObservedRunningTime="2026-07-06 17:53:51.594992327 +0000 UTC m=+125.083519432" Jul 06 17:53:52.456903 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:52.456868 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bbc86d56-v5pgx" Jul 06 17:53:56.716225 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:56.716189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:53:56.718775 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:56.718743 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531fa1a5-8510-4f8a-9b89-a4de09058097-metrics-certs\") pod \"network-metrics-daemon-z8qkc\" (UID: \"531fa1a5-8510-4f8a-9b89-a4de09058097\") " pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:53:56.744203 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:56.744176 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-22ww9\"" Jul 06 17:53:56.752582 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:53:56.752556 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8qkc" Jul 06 17:54:01.553867 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.553823 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8qkc"] Jul 06 17:54:01.555502 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:54:01.555475 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531fa1a5_8510_4f8a_9b89_a4de09058097.slice/crio-dca1477692ea043c589463e901024cb37adb30f7101f5749abcc3a78d7492984 WatchSource:0}: Error finding container dca1477692ea043c589463e901024cb37adb30f7101f5749abcc3a78d7492984: Status 404 returned error can't find the container with id dca1477692ea043c589463e901024cb37adb30f7101f5749abcc3a78d7492984 Jul 06 17:54:01.614738 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.614664 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qh72c" event={"ID":"8e681b1e-2ee2-4674-b19c-d27f1c0152c8","Type":"ContainerStarted","Data":"aed026e076f13eb765188a0e8e4660bd133f1e1f01f3655f0e02e6129f99d4e2"} Jul 06 17:54:01.614867 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.614840 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:54:01.615988 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.615965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8qkc" event={"ID":"531fa1a5-8510-4f8a-9b89-a4de09058097","Type":"ContainerStarted","Data":"dca1477692ea043c589463e901024cb37adb30f7101f5749abcc3a78d7492984"} Jul 06 17:54:01.616373 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.616340 2555 patch_prober.go:28] interesting pod/downloads-685bfb5f64-qh72c container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.17:8080/\": dial tcp 10.133.0.17:8080: connect: connection refused" start-of-body= Jul 06 17:54:01.616493 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.616400 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-qh72c" podUID="8e681b1e-2ee2-4674-b19c-d27f1c0152c8" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.17:8080/\": dial tcp 10.133.0.17:8080: connect: connection refused" Jul 06 17:54:01.617920 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.617901 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"66eae23590fee666f722140e59009d4815b6e0e61fe96f8d16bfd3621bdca5ab"} Jul 06 17:54:01.637413 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:01.637369 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-qh72c" podStartSLOduration=1.5260326800000001 podStartE2EDuration="23.637354713s" totalImagesPullingTime="22.111322033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:54:01.636182882 +0000 UTC m=+135.124709987" watchObservedRunningTime="2026-07-06 17:54:01.637354713 +0000 UTC m=+135.125881836" Jul 06 17:54:02.626621 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:02.626565 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"44daa61201b02bd4cd041a1b99ee6dbb581c2b03b5ce04ac60ca381fbf6d08b3"} Jul 06 17:54:02.641656 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:02.641605 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-qh72c" Jul 06 17:54:03.634270 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:03.634148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8qkc" event={"ID":"531fa1a5-8510-4f8a-9b89-a4de09058097","Type":"ContainerStarted","Data":"675e8d783b1ed5ee3d7e7b5095adb1fc415a58c49c0fcd1221f23fb9061c89f1"} Jul 06 17:54:04.641356 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:04.641267 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8qkc" event={"ID":"531fa1a5-8510-4f8a-9b89-a4de09058097","Type":"ContainerStarted","Data":"265516c12bf81a95d789bef8361e6101ee0030c98dd3813fa63574408aeb38d4"} Jul 06 17:54:04.661415 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:04.661362 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z8qkc" podStartSLOduration=135.804971718 podStartE2EDuration="2m17.66133926s" totalImagesPullingTime="1.856367542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:54:04.659480374 +0000 UTC m=+138.148007481" watchObservedRunningTime="2026-07-06 17:54:04.66133926 +0000 UTC m=+138.149866369" Jul 06 17:54:05.650461 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:05.650399 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"c5558e6fbadae3ead1f9a1d79f06322ee4f304a01aeb796b7aeebf6a79d843b8"} Jul 06 17:54:05.650911 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:05.650507 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"650f124d435f66d65ad4a3c9d64fdf5b325d0e1d7f334c16111ac2289c54aebf"} Jul 06 17:54:05.650911 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:05.650554 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"2c01f9d4eea227496a240a9c37ab1fed4fd66e0d348b6fc5b5a0fa02e537cb26"} Jul 06 17:54:05.650911 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:05.650591 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerStarted","Data":"1057d68cb2262e6a07f3c609c906dd0c346d2ee58bd590ddee4820e0cbadfbef"} Jul 06 17:54:05.683724 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:05.683667 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.740734114 podStartE2EDuration="17.683642873s" totalImagesPullingTime="14.921130115s" totalInitContainerRuntime="21.778644ms" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:54:05.681064304 +0000 UTC m=+139.169591412" watchObservedRunningTime="2026-07-06 17:54:05.683642873 +0000 UTC m=+139.172169977" Jul 06 17:54:06.551163 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:06.551128 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:54:06.551356 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:06.551194 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:54:08.603273 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:08.603232 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:54:14.696773 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:14.696741 2555 generic.go:356] "Generic (PLEG): container finished" podID="668a7758-f76a-4fff-954b-9bc33ff6c8d9" containerID="9a63b970016283099bc4cbba197814884b072595c692cbbe87a70ef75fe00032" exitCode=0 Jul 06 17:54:14.697341 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:14.696821 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" event={"ID":"668a7758-f76a-4fff-954b-9bc33ff6c8d9","Type":"ContainerDied","Data":"9a63b970016283099bc4cbba197814884b072595c692cbbe87a70ef75fe00032"} Jul 06 17:54:14.697341 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:14.697215 2555 scope.go:117] "RemoveContainer" containerID="9a63b970016283099bc4cbba197814884b072595c692cbbe87a70ef75fe00032" Jul 06 17:54:15.703730 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:15.703695 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2w2v5" event={"ID":"668a7758-f76a-4fff-954b-9bc33ff6c8d9","Type":"ContainerStarted","Data":"a7d203901dc0bfc912ad585d57a66ffdab77ee5ea09618b9b3ad4f896e3a53a4"} Jul 06 17:54:22.733746 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:22.733656 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2983798-4872-4cf4-acb0-917cce4269cc" containerID="bdca8ec61cd99d18504ff291872b31ebe52c2dba3723d013d2eb44ad909a9535" exitCode=0 Jul 06 17:54:22.733746 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:22.733720 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" event={"ID":"d2983798-4872-4cf4-acb0-917cce4269cc","Type":"ContainerDied","Data":"bdca8ec61cd99d18504ff291872b31ebe52c2dba3723d013d2eb44ad909a9535"} Jul 06 17:54:22.734239 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:22.734074 2555 scope.go:117] "RemoveContainer" containerID="bdca8ec61cd99d18504ff291872b31ebe52c2dba3723d013d2eb44ad909a9535" Jul 06 17:54:23.740728 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:23.740697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78sss" event={"ID":"d2983798-4872-4cf4-acb0-917cce4269cc","Type":"ContainerStarted","Data":"69beae380dd94bbcb41c140a475db9a335023eee73f8c4e8882996c07e7af17f"} Jul 06 17:54:26.556323 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:26.556293 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:54:26.560044 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:26.560023 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-658799bb8d-zd9k8" Jul 06 17:54:48.603071 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:48.602975 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:54:48.682143 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:48.682115 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:54:48.856891 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:54:48.856817 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:06.706884 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.706844 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707236 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy" containerID="cri-o://650f124d435f66d65ad4a3c9d64fdf5b325d0e1d7f334c16111ac2289c54aebf" gracePeriod=600 Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707287 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c5558e6fbadae3ead1f9a1d79f06322ee4f304a01aeb796b7aeebf6a79d843b8" gracePeriod=600 Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707228 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="prometheus" containerID="cri-o://66eae23590fee666f722140e59009d4815b6e0e61fe96f8d16bfd3621bdca5ab" gracePeriod=600 Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707304 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="config-reloader" containerID="cri-o://44daa61201b02bd4cd041a1b99ee6dbb581c2b03b5ce04ac60ca381fbf6d08b3" gracePeriod=600 Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707286 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="thanos-sidecar" containerID="cri-o://1057d68cb2262e6a07f3c609c906dd0c346d2ee58bd590ddee4820e0cbadfbef" gracePeriod=600 Jul 06 17:55:06.707540 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.707309 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-web" containerID="cri-o://2c01f9d4eea227496a240a9c37ab1fed4fd66e0d348b6fc5b5a0fa02e537cb26" gracePeriod=600 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915297 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="c5558e6fbadae3ead1f9a1d79f06322ee4f304a01aeb796b7aeebf6a79d843b8" exitCode=0 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915321 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="650f124d435f66d65ad4a3c9d64fdf5b325d0e1d7f334c16111ac2289c54aebf" exitCode=0 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915329 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="2c01f9d4eea227496a240a9c37ab1fed4fd66e0d348b6fc5b5a0fa02e537cb26" exitCode=0 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915334 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="1057d68cb2262e6a07f3c609c906dd0c346d2ee58bd590ddee4820e0cbadfbef" exitCode=0 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915339 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="44daa61201b02bd4cd041a1b99ee6dbb581c2b03b5ce04ac60ca381fbf6d08b3" exitCode=0 Jul 06 17:55:06.915334 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915344 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8702880-7d50-4e85-ad17-143f38712a82" containerID="66eae23590fee666f722140e59009d4815b6e0e61fe96f8d16bfd3621bdca5ab" exitCode=0 Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915373 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"c5558e6fbadae3ead1f9a1d79f06322ee4f304a01aeb796b7aeebf6a79d843b8"} Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915482 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"650f124d435f66d65ad4a3c9d64fdf5b325d0e1d7f334c16111ac2289c54aebf"} Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"2c01f9d4eea227496a240a9c37ab1fed4fd66e0d348b6fc5b5a0fa02e537cb26"} Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915564 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"1057d68cb2262e6a07f3c609c906dd0c346d2ee58bd590ddee4820e0cbadfbef"} Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"44daa61201b02bd4cd041a1b99ee6dbb581c2b03b5ce04ac60ca381fbf6d08b3"} Jul 06 17:55:06.915771 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.915692 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"66eae23590fee666f722140e59009d4815b6e0e61fe96f8d16bfd3621bdca5ab"} Jul 06 17:55:06.938947 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:06.938922 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:07.044251 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044211 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044265 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044284 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044310 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044325 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044346 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044378 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044416 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4k5m\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044478 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044504 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044534 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044567 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044592 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044654 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044679 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044673 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044718 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044749 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044772 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044780 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.044840 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.044799 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.045495 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045153 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.045495 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045255 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d8702880-7d50-4e85-ad17-143f38712a82\" (UID: \"d8702880-7d50-4e85-ad17-143f38712a82\") " Jul 06 17:55:07.045620 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045597 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.045674 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045623 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.045674 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045638 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-metrics-client-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.045783 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.045758 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.046566 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.046536 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.046745 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.046718 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.046960 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.046935 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:55:07.047374 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.047274 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:55:07.048055 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.047948 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.048055 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.048019 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.048308 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.048268 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.048368 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.048327 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.049377 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.049347 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m" (OuterVolumeSpecName: "kube-api-access-k4k5m") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "kube-api-access-k4k5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:55:07.049590 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.049374 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:55:07.049590 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.049485 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.049730 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.049704 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.049823 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.049731 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config" (OuterVolumeSpecName: "config") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.050140 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.050119 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out" (OuterVolumeSpecName: "config-out") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:55:07.050308 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.050294 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.058654 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.058630 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config" (OuterVolumeSpecName: "web-config") pod "d8702880-7d50-4e85-ad17-143f38712a82" (UID: "d8702880-7d50-4e85-ad17-143f38712a82"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:55:07.146407 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146371 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146407 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146399 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-config-out\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146407 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146412 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-kube-rbac-proxy\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146490 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146504 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146515 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-tls-assets\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146527 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-metrics-client-certs\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146541 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146554 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146566 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146577 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-secret-grpc-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146589 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-web-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146599 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8702880-7d50-4e85-ad17-143f38712a82-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146612 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4k5m\" (UniqueName: \"kubernetes.io/projected/d8702880-7d50-4e85-ad17-143f38712a82-kube-api-access-k4k5m\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146627 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-db\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146640 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.146707 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.146679 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8702880-7d50-4e85-ad17-143f38712a82-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:55:07.922498 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.922460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8702880-7d50-4e85-ad17-143f38712a82","Type":"ContainerDied","Data":"dea231afcec3dde54e52d2aff4ddc427429814f7a0381b59e47e736e400c3595"} Jul 06 17:55:07.922498 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.922483 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:07.922933 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.922571 2555 scope.go:117] "RemoveContainer" containerID="c5558e6fbadae3ead1f9a1d79f06322ee4f304a01aeb796b7aeebf6a79d843b8" Jul 06 17:55:07.930873 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.930850 2555 scope.go:117] "RemoveContainer" containerID="650f124d435f66d65ad4a3c9d64fdf5b325d0e1d7f334c16111ac2289c54aebf" Jul 06 17:55:07.937756 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.937741 2555 scope.go:117] "RemoveContainer" containerID="2c01f9d4eea227496a240a9c37ab1fed4fd66e0d348b6fc5b5a0fa02e537cb26" Jul 06 17:55:07.945552 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.945537 2555 scope.go:117] "RemoveContainer" containerID="1057d68cb2262e6a07f3c609c906dd0c346d2ee58bd590ddee4820e0cbadfbef" Jul 06 17:55:07.948962 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.948944 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:07.952657 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.952623 2555 scope.go:117] "RemoveContainer" containerID="44daa61201b02bd4cd041a1b99ee6dbb581c2b03b5ce04ac60ca381fbf6d08b3" Jul 06 17:55:07.955023 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.955002 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:07.959638 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.959622 2555 scope.go:117] "RemoveContainer" containerID="66eae23590fee666f722140e59009d4815b6e0e61fe96f8d16bfd3621bdca5ab" Jul 06 17:55:07.966664 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.966648 2555 scope.go:117] "RemoveContainer" containerID="dd534e8e0cc49ef27319c855bf343ef59d1b21e96974dd4359da9408b0c393da" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.988593 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989020 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-thanos" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989038 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-thanos" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989052 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="config-reloader" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989060 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="config-reloader" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989076 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="prometheus" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989084 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="prometheus" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989093 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-web" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989101 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-web" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989113 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="init-config-reloader" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989122 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="init-config-reloader" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989144 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989151 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989169 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="thanos-sidecar" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989183 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="thanos-sidecar" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989262 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-web" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989273 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989281 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="kube-rbac-proxy-thanos" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989290 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="thanos-sidecar" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989300 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="prometheus" Jul 06 17:55:07.991332 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.989311 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8702880-7d50-4e85-ad17-143f38712a82" containerName="config-reloader" Jul 06 17:55:07.997380 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:07.997357 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.002406 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.002389 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 17:55:08.002803 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.002781 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 17:55:08.002920 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.002897 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 17:55:08.003014 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.002995 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 17:55:08.003117 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003097 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 17:55:08.003186 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003142 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 17:55:08.003267 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003247 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4rn3eksptk0hm\"" Jul 06 17:55:08.003587 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003568 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-79pmb\"" Jul 06 17:55:08.003687 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003639 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 17:55:08.003919 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.003896 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 17:55:08.007171 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.007155 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 17:55:08.008551 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.008538 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 17:55:08.010811 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.010797 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 17:55:08.011084 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.011072 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 17:55:08.041662 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.041643 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 17:55:08.041923 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.041908 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:08.057917 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.057899 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 17:55:08.154515 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-web-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154855 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154855 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5kfr\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-kube-api-access-r5kfr\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154855 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.154855 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154854 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155021 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.154982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-config-out\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155278 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.155036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155278 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.155079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155278 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.155104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155278 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.155137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.155278 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.155163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256076 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-config-out\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256201 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256201 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256201 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256201 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.256399 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256204 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256574 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256606 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-web-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5kfr\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-kube-api-access-r5kfr\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256810 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256925 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256948 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.256987 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.257462 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.257137 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.259022 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.258997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.259861 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.259336 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.259861 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.259780 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.260018 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.259939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.260323 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.260115 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.260323 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.260269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24683bc9-aff6-4665-871b-32159ef4a15a-config-out\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.260525 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.260504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.260600 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.260540 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.261169 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.261021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24683bc9-aff6-4665-871b-32159ef4a15a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.261169 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.261121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.261315 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.261215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.261753 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.261729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.261841 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.261792 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.262208 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.262180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.262460 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.262442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.262513 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.262442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24683bc9-aff6-4665-871b-32159ef4a15a-web-config\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.271782 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.271762 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5kfr\" (UniqueName: \"kubernetes.io/projected/24683bc9-aff6-4665-871b-32159ef4a15a-kube-api-access-r5kfr\") pod \"prometheus-k8s-0\" (UID: \"24683bc9-aff6-4665-871b-32159ef4a15a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.306831 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.306809 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:55:08.449630 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.449603 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 17:55:08.451350 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:55:08.451322 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24683bc9_aff6_4665_871b_32159ef4a15a.slice/crio-4ac673cde4d9d74128c30316612401089026592a56644449f95ad99e223a8b39 WatchSource:0}: Error finding container 4ac673cde4d9d74128c30316612401089026592a56644449f95ad99e223a8b39: Status 404 returned error can't find the container with id 4ac673cde4d9d74128c30316612401089026592a56644449f95ad99e223a8b39 Jul 06 17:55:08.928305 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.928222 2555 generic.go:356] "Generic (PLEG): container finished" podID="24683bc9-aff6-4665-871b-32159ef4a15a" containerID="01b96c255d902bc13022c98a82f64af5ec1e785611182cda803228be89c8d958" exitCode=0 Jul 06 17:55:08.928305 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.928277 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerDied","Data":"01b96c255d902bc13022c98a82f64af5ec1e785611182cda803228be89c8d958"} Jul 06 17:55:08.928690 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:08.928325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"4ac673cde4d9d74128c30316612401089026592a56644449f95ad99e223a8b39"} Jul 06 17:55:09.034702 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.034674 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8702880-7d50-4e85-ad17-143f38712a82" path="/var/lib/kubelet/pods/d8702880-7d50-4e85-ad17-143f38712a82/volumes" Jul 06 17:55:09.938901 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.938871 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"e857412491e93a0b2e117103cf5b6d5ebc38e4a85cae851e4dc2b671875ec2f6"} Jul 06 17:55:09.939266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.938934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"a95703f84ad8c04c04e928f82e59d719e2b502dc6aa45b42192b81f21c309bbd"} Jul 06 17:55:09.939266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.938959 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"91f9d06524359b2f78fd0847acd78353af2224c3f118cb9db1ceb9a9e75d82c5"} Jul 06 17:55:09.939266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.938983 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"718041adf7841b2d1f65ae3c6b36d2a0b72c56c0cc4b4d2a0f8bceaa92060c55"} Jul 06 17:55:09.939266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.939005 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"9f39fed463343e337df05f03fef6fcfe7ea8460627086f2100289238e409e5d5"} Jul 06 17:55:09.939266 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.939027 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24683bc9-aff6-4665-871b-32159ef4a15a","Type":"ContainerStarted","Data":"54ce7772f9a0f724f77ee590efe6a4dcb5decedf3740dbf4a783331b15a23ac0"} Jul 06 17:55:09.978725 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:09.978675 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.963177719 podStartE2EDuration="2.97865551s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.477791ms" isStatefulPod=false podCreationTimestamp="2026-07-06 17:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:55:09.975385372 +0000 UTC m=+203.463912476" watchObservedRunningTime="2026-07-06 17:55:09.97865551 +0000 UTC m=+203.467182616" Jul 06 17:55:13.307785 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:55:13.307741 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:56:08.307084 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:56:08.306980 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:56:08.322317 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:56:08.322290 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:56:09.179409 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:56:09.179382 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 17:56:46.908520 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:56:46.908486 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 17:57:19.234720 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.234687 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52"] Jul 06 17:57:19.236701 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.236686 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.239882 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.239857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 17:57:19.241668 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.241611 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 17:57:19.241668 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.241646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 17:57:19.241668 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.241656 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 17:57:19.241921 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.241908 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2c6xq\"" Jul 06 17:57:19.258189 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.258166 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52"] Jul 06 17:57:19.347222 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.347191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.347387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.347243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.347387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.347326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt55g\" (UniqueName: \"kubernetes.io/projected/f04addbe-a657-467f-9c34-15539a6b323d-kube-api-access-xt55g\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.347387 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.347371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.347516 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.347392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448406 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt55g\" (UniqueName: \"kubernetes.io/projected/f04addbe-a657-467f-9c34-15539a6b323d-kube-api-access-xt55g\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448406 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448640 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448640 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448640 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.448950 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.448931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.450803 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.450769 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f04addbe-a657-467f-9c34-15539a6b323d-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.450943 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.450887 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.451068 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.451048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f04addbe-a657-467f-9c34-15539a6b323d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.458737 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.458713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt55g\" (UniqueName: \"kubernetes.io/projected/f04addbe-a657-467f-9c34-15539a6b323d-kube-api-access-xt55g\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-9bh52\" (UID: \"f04addbe-a657-467f-9c34-15539a6b323d\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.547354 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.547313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:19.692200 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.692176 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52"] Jul 06 17:57:19.694713 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:57:19.694686 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04addbe_a657_467f_9c34_15539a6b323d.slice/crio-bf80745a3168086d7b3579f3af0ea4a86683679744677f2372af3629de72efb0 WatchSource:0}: Error finding container bf80745a3168086d7b3579f3af0ea4a86683679744677f2372af3629de72efb0: Status 404 returned error can't find the container with id bf80745a3168086d7b3579f3af0ea4a86683679744677f2372af3629de72efb0 Jul 06 17:57:19.696517 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:19.696498 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:57:20.443690 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:20.443652 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" event={"ID":"f04addbe-a657-467f-9c34-15539a6b323d","Type":"ContainerStarted","Data":"bf80745a3168086d7b3579f3af0ea4a86683679744677f2372af3629de72efb0"} Jul 06 17:57:23.460939 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:23.460903 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" event={"ID":"f04addbe-a657-467f-9c34-15539a6b323d","Type":"ContainerStarted","Data":"e14d4eb3217208488640d2a571ce32f1d1ebfe400fd24480e795987124d916eb"} Jul 06 17:57:24.466661 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:24.466631 2555 generic.go:356] "Generic (PLEG): container finished" podID="f04addbe-a657-467f-9c34-15539a6b323d" containerID="e14d4eb3217208488640d2a571ce32f1d1ebfe400fd24480e795987124d916eb" exitCode=0 Jul 06 17:57:24.467034 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:24.466715 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" event={"ID":"f04addbe-a657-467f-9c34-15539a6b323d","Type":"ContainerDied","Data":"e14d4eb3217208488640d2a571ce32f1d1ebfe400fd24480e795987124d916eb"} Jul 06 17:57:25.478565 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:25.478532 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" event={"ID":"f04addbe-a657-467f-9c34-15539a6b323d","Type":"ContainerStarted","Data":"98993159f28a3ecb6d89d30a2d7ef75dbc83f365214cd911202badedb4449979"} Jul 06 17:57:25.479005 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:25.478644 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:25.514805 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:25.514761 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" podStartSLOduration=2.064324403 podStartE2EDuration="6.51474748s" totalImagesPullingTime="3.407534256s" totalInitContainerRuntime="1.042888821s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:25.514174096 +0000 UTC m=+339.002701200" watchObservedRunningTime="2026-07-06 17:57:25.51474748 +0000 UTC m=+339.003274583" Jul 06 17:57:36.485025 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:36.484998 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-9bh52" Jul 06 17:57:46.877970 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.877894 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx"] Jul 06 17:57:46.881192 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.881175 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:46.884708 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884685 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xjdzk\"" Jul 06 17:57:46.884869 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884732 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 17:57:46.884949 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884750 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 17:57:46.884949 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 17:57:46.884949 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884752 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:57:46.885104 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.884757 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 17:57:46.891211 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.891190 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx"] Jul 06 17:57:46.984183 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.984157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-metrics-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:46.984337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.984201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:46.984337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.984248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/601a1bf3-157e-4829-b346-7c678d4846c9-manager-config\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:46.984337 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:46.984294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgx2\" (UniqueName: \"kubernetes.io/projected/601a1bf3-157e-4829-b346-7c678d4846c9-kube-api-access-bjgx2\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.085649 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.085616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.085836 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.085666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/601a1bf3-157e-4829-b346-7c678d4846c9-manager-config\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.085836 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.085709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgx2\" (UniqueName: \"kubernetes.io/projected/601a1bf3-157e-4829-b346-7c678d4846c9-kube-api-access-bjgx2\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.085836 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.085736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-metrics-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.086384 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.086360 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/601a1bf3-157e-4829-b346-7c678d4846c9-manager-config\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.087984 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.087962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.088072 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.088026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/601a1bf3-157e-4829-b346-7c678d4846c9-metrics-cert\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.095370 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.095352 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgx2\" (UniqueName: \"kubernetes.io/projected/601a1bf3-157e-4829-b346-7c678d4846c9-kube-api-access-bjgx2\") pod \"lws-controller-manager-88fc8bffd-59qlx\" (UID: \"601a1bf3-157e-4829-b346-7c678d4846c9\") " pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.191839 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.191753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:47.335863 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.335665 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx"] Jul 06 17:57:47.338269 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:57:47.338240 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601a1bf3_157e_4829_b346_7c678d4846c9.slice/crio-4de64b0b4c01414dce92e074bc49bb0fa14e328c90a388741c63a34a5ac5cc07 WatchSource:0}: Error finding container 4de64b0b4c01414dce92e074bc49bb0fa14e328c90a388741c63a34a5ac5cc07: Status 404 returned error can't find the container with id 4de64b0b4c01414dce92e074bc49bb0fa14e328c90a388741c63a34a5ac5cc07 Jul 06 17:57:47.579223 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:47.579183 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" event={"ID":"601a1bf3-157e-4829-b346-7c678d4846c9","Type":"ContainerStarted","Data":"4de64b0b4c01414dce92e074bc49bb0fa14e328c90a388741c63a34a5ac5cc07"} Jul 06 17:57:49.400845 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.400807 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx"] Jul 06 17:57:49.404714 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.404690 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.407533 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407508 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 17:57:49.407677 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407656 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 17:57:49.407745 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407564 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 17:57:49.407745 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407725 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2zrwd\"" Jul 06 17:57:49.407846 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407621 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 17:57:49.407846 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407525 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 17:57:49.407846 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.407595 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 17:57:49.420073 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.420049 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx"] Jul 06 17:57:49.508373 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508373 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508595 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508595 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508612 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jjz\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-kube-api-access-w5jjz\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508676 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.508765 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.508684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f45bf00-daed-497c-9015-dfc1efa9bba8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609323 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609282 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f45bf00-daed-497c-9015-dfc1efa9bba8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609528 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609528 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609528 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609528 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609720 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jjz\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-kube-api-access-w5jjz\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.609720 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.609604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.610204 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.610180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.612145 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.612119 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f45bf00-daed-497c-9015-dfc1efa9bba8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.612252 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.612179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.612399 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.612377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.612470 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.612388 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f45bf00-daed-497c-9015-dfc1efa9bba8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.628696 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.628665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.630832 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.630804 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jjz\" (UniqueName: \"kubernetes.io/projected/1f45bf00-daed-497c-9015-dfc1efa9bba8-kube-api-access-w5jjz\") pod \"istiod-openshift-gateway-94bb8fbfd-w6jjx\" (UID: \"1f45bf00-daed-497c-9015-dfc1efa9bba8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.716992 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.716907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:49.866224 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:49.866169 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx"] Jul 06 17:57:49.869168 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:57:49.869143 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f45bf00_daed_497c_9015_dfc1efa9bba8.slice/crio-24d710cb5c8d0eb6086b8b3517d48be2e3c2cf95e7a942f24a523b72efef90d3 WatchSource:0}: Error finding container 24d710cb5c8d0eb6086b8b3517d48be2e3c2cf95e7a942f24a523b72efef90d3: Status 404 returned error can't find the container with id 24d710cb5c8d0eb6086b8b3517d48be2e3c2cf95e7a942f24a523b72efef90d3 Jul 06 17:57:50.595088 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:50.595053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" event={"ID":"601a1bf3-157e-4829-b346-7c678d4846c9","Type":"ContainerStarted","Data":"903fe2e3ae2a20603a00704b3cdd3b9ccd4b6864000dc661d3a569357a5471ca"} Jul 06 17:57:50.595636 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:50.595112 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:57:50.596294 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:50.596266 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" event={"ID":"1f45bf00-daed-497c-9015-dfc1efa9bba8","Type":"ContainerStarted","Data":"24d710cb5c8d0eb6086b8b3517d48be2e3c2cf95e7a942f24a523b72efef90d3"} Jul 06 17:57:50.645741 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:50.645687 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" podStartSLOduration=2.204922258 podStartE2EDuration="4.645671021s" totalImagesPullingTime="2.440748763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:50.642772244 +0000 UTC m=+364.131299350" watchObservedRunningTime="2026-07-06 17:57:50.645671021 +0000 UTC m=+364.134198125" Jul 06 17:57:53.644100 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:53.644053 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:57:53.644385 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:53.644118 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:57:54.617022 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:54.616984 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" event={"ID":"1f45bf00-daed-497c-9015-dfc1efa9bba8","Type":"ContainerStarted","Data":"9b8be8e491524c270a15a9a8e8fcedbbbf469681b21d5679745757e810b9c15c"} Jul 06 17:57:54.617205 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:54.617184 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:57:54.618578 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:54.618551 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-w6jjx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 17:57:54.618697 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:54.618604 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" podUID="1f45bf00-daed-497c-9015-dfc1efa9bba8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:57:54.656454 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:54.656373 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" podStartSLOduration=1.883871093 podStartE2EDuration="5.656356912s" totalImagesPullingTime="3.772485819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:54.654267787 +0000 UTC m=+368.142794892" watchObservedRunningTime="2026-07-06 17:57:54.656356912 +0000 UTC m=+368.144884015" Jul 06 17:57:55.624060 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:57:55.624031 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w6jjx" Jul 06 17:58:01.603213 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:58:01.603170 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 17:59:37.900373 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.900343 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt"] Jul 06 17:59:37.903614 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.903597 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:37.906372 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.906350 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 17:59:37.906666 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.906633 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 17:59:37.907045 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.907031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w2lq6\"" Jul 06 17:59:37.919403 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.919378 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt"] Jul 06 17:59:37.945390 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.945364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4qp\" (UniqueName: \"kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:37.945550 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:37.945395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.046727 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.046690 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4qp\" (UniqueName: \"kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.046903 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.046733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.047124 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.047106 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.056601 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.056579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4qp\" (UniqueName: \"kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp\") pod \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.214899 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.214823 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:38.351828 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.351801 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt"] Jul 06 17:59:38.353928 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:59:38.353901 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e587bf_8ec8_414e_ab57_9fc2105c70cf.slice/crio-07e819e4cd9545c45f4296a4f87307fb3257002021545bfaf7fef3e24f68b9cc WatchSource:0}: Error finding container 07e819e4cd9545c45f4296a4f87307fb3257002021545bfaf7fef3e24f68b9cc: Status 404 returned error can't find the container with id 07e819e4cd9545c45f4296a4f87307fb3257002021545bfaf7fef3e24f68b9cc Jul 06 17:59:38.445159 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.445130 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt"] Jul 06 17:59:38.449055 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.449030 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt"] Jul 06 17:59:38.465832 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.465755 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 17:59:38.470588 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.470564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.485374 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.485349 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 17:59:38.550838 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.550804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrvq\" (UniqueName: \"kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.550998 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.550875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.652138 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.652106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrvq\" (UniqueName: \"kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.652322 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.652156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.652530 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.652510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.660416 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.660385 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrvq\" (UniqueName: \"kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq\") pod \"kuadrant-operator-controller-manager-55467d9f7-7bmqt\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.782601 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.782568 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:38.927892 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:38.927856 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 17:59:38.928255 ip-10-0-134-39 kubenswrapper[2555]: W0706 17:59:38.928231 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6714ab_13e2_458f_b0d2_78b5da3c9ae4.slice/crio-5258660e0dd462711d83ed2d99977bbe3c5481d9fa8098ab383a8af32a515af8 WatchSource:0}: Error finding container 5258660e0dd462711d83ed2d99977bbe3c5481d9fa8098ab383a8af32a515af8: Status 404 returned error can't find the container with id 5258660e0dd462711d83ed2d99977bbe3c5481d9fa8098ab383a8af32a515af8 Jul 06 17:59:39.082804 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:39.082736 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" event={"ID":"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4","Type":"ContainerStarted","Data":"5258660e0dd462711d83ed2d99977bbe3c5481d9fa8098ab383a8af32a515af8"} Jul 06 17:59:44.107441 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.107368 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" containerName="manager" containerID="cri-o://95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f" gracePeriod=2 Jul 06 17:59:44.108984 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.108956 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" event={"ID":"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4","Type":"ContainerStarted","Data":"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07"} Jul 06 17:59:44.109132 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.109078 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 17:59:44.136400 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.136356 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" podStartSLOduration=1.516839811 podStartE2EDuration="6.136342427s" totalImagesPullingTime="4.619502616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:44.134532535 +0000 UTC m=+477.623059639" watchObservedRunningTime="2026-07-06 17:59:44.136342427 +0000 UTC m=+477.624869531" Jul 06 17:59:44.356024 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.356000 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:44.358507 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:59:44.358451 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:44.406993 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.406965 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume\") pod \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " Jul 06 17:59:44.407132 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.407049 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc4qp\" (UniqueName: \"kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp\") pod \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\" (UID: \"92e587bf-8ec8-414e-ab57-9fc2105c70cf\") " Jul 06 17:59:44.407272 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.407246 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "92e587bf-8ec8-414e-ab57-9fc2105c70cf" (UID: "92e587bf-8ec8-414e-ab57-9fc2105c70cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:59:44.409147 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.409128 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp" (OuterVolumeSpecName: "kube-api-access-rc4qp") pod "92e587bf-8ec8-414e-ab57-9fc2105c70cf" (UID: "92e587bf-8ec8-414e-ab57-9fc2105c70cf"). InnerVolumeSpecName "kube-api-access-rc4qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:59:44.507647 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.507618 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc4qp\" (UniqueName: \"kubernetes.io/projected/92e587bf-8ec8-414e-ab57-9fc2105c70cf-kube-api-access-rc4qp\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:59:44.507647 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:44.507641 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92e587bf-8ec8-414e-ab57-9fc2105c70cf-extensions-socket-volume\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 17:59:45.034885 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.034852 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" path="/var/lib/kubelet/pods/92e587bf-8ec8-414e-ab57-9fc2105c70cf/volumes" Jul 06 17:59:45.115116 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.115085 2555 generic.go:356] "Generic (PLEG): container finished" podID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" containerID="95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f" exitCode=2 Jul 06 17:59:45.115535 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.115137 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:45.115535 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.115192 2555 scope.go:117] "RemoveContainer" containerID="95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f" Jul 06 17:59:45.119810 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:59:45.119785 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:45.124113 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.124090 2555 scope.go:117] "RemoveContainer" containerID="95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f" Jul 06 17:59:45.124361 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:59:45.124341 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f\": container with ID starting with 95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f not found: ID does not exist" containerID="95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f" Jul 06 17:59:45.124451 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:45.124369 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f"} err="failed to get container status \"95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f\": rpc error: code = NotFound desc = could not find container \"95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f\": container with ID starting with 95911f6f8673006a0f488f67a625d827eb9ba723f34aaeb72330cdd71745df9f not found: ID does not exist" Jul 06 17:59:47.034748 ip-10-0-134-39 kubenswrapper[2555]: E0706 17:59:47.034712 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-46gkt\" is forbidden: User \"system:node:ip-10-0-134-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-39.ec2.internal' and this object" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-46gkt" Jul 06 17:59:55.117965 ip-10-0-134-39 kubenswrapper[2555]: I0706 17:59:55.117928 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 18:00:07.871287 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:07.871243 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 18:00:07.871929 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:07.871599 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" podUID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" containerName="manager" containerID="cri-o://62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07" gracePeriod=10 Jul 06 18:00:08.129082 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.129022 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 18:00:08.219833 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.219795 2555 generic.go:356] "Generic (PLEG): container finished" podID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" containerID="62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07" exitCode=0 Jul 06 18:00:08.219833 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.219840 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" Jul 06 18:00:08.220069 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.219840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" event={"ID":"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4","Type":"ContainerDied","Data":"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07"} Jul 06 18:00:08.220069 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.219893 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt" event={"ID":"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4","Type":"ContainerDied","Data":"5258660e0dd462711d83ed2d99977bbe3c5481d9fa8098ab383a8af32a515af8"} Jul 06 18:00:08.220069 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.219923 2555 scope.go:117] "RemoveContainer" containerID="62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07" Jul 06 18:00:08.222193 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.222166 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhrvq\" (UniqueName: \"kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq\") pod \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " Jul 06 18:00:08.222306 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.222207 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume\") pod \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\" (UID: \"6b6714ab-13e2-458f-b0d2-78b5da3c9ae4\") " Jul 06 18:00:08.222641 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.222620 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" (UID: "6b6714ab-13e2-458f-b0d2-78b5da3c9ae4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:00:08.224133 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.224106 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq" (OuterVolumeSpecName: "kube-api-access-jhrvq") pod "6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" (UID: "6b6714ab-13e2-458f-b0d2-78b5da3c9ae4"). InnerVolumeSpecName "kube-api-access-jhrvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:08.234417 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.234398 2555 scope.go:117] "RemoveContainer" containerID="62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07" Jul 06 18:00:08.234728 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:00:08.234711 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07\": container with ID starting with 62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07 not found: ID does not exist" containerID="62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07" Jul 06 18:00:08.234779 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.234740 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07"} err="failed to get container status \"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07\": rpc error: code = NotFound desc = could not find container \"62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07\": container with ID starting with 62e4fd57fa8efb25277e6f6e6964fb47492e3003ce683166f102d183cdd2be07 not found: ID does not exist" Jul 06 18:00:08.322949 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.322919 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhrvq\" (UniqueName: \"kubernetes.io/projected/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-kube-api-access-jhrvq\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:00:08.322949 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.322946 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4-extensions-socket-volume\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:00:08.542274 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.542239 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 18:00:08.549159 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:08.549128 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7bmqt"] Jul 06 18:00:09.040914 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:09.040884 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" path="/var/lib/kubelet/pods/6b6714ab-13e2-458f-b0d2-78b5da3c9ae4/volumes" Jul 06 18:00:24.900882 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.900847 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:24.901260 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901211 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" containerName="manager" Jul 06 18:00:24.901260 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901222 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" containerName="manager" Jul 06 18:00:24.901260 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901229 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" containerName="manager" Jul 06 18:00:24.901260 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901236 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" containerName="manager" Jul 06 18:00:24.901390 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901282 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b6714ab-13e2-458f-b0d2-78b5da3c9ae4" containerName="manager" Jul 06 18:00:24.901390 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.901294 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e587bf-8ec8-414e-ab57-9fc2105c70cf" containerName="manager" Jul 06 18:00:24.904564 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.904545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:24.907159 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.907103 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 18:00:24.907280 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.907168 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 18:00:24.907280 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.907190 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 18:00:24.907370 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.907358 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6w8b2\"" Jul 06 18:00:24.913876 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.913852 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:24.966723 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.966684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slwxl\" (UniqueName: \"kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:24.966879 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.966864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:24.991493 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:24.991461 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:25.067981 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.067948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:25.068166 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.068014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slwxl\" (UniqueName: \"kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:25.068703 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.068684 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:25.077052 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.077028 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slwxl\" (UniqueName: \"kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl\") pod \"limitador-limitador-64c94fd64f-6g6d6\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:25.214986 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.214897 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:25.345615 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:25.345582 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:25.348660 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:00:25.348625 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8253379f_56c4_4e0d_be85_014c6a192341.slice/crio-f5d477a64f17da9360c520e3cdeaa041f28393a6cf504d1d9743a93e9bf060e5 WatchSource:0}: Error finding container f5d477a64f17da9360c520e3cdeaa041f28393a6cf504d1d9743a93e9bf060e5: Status 404 returned error can't find the container with id f5d477a64f17da9360c520e3cdeaa041f28393a6cf504d1d9743a93e9bf060e5 Jul 06 18:00:26.301570 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:26.301533 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" event={"ID":"8253379f-56c4-4e0d-be85-014c6a192341","Type":"ContainerStarted","Data":"f5d477a64f17da9360c520e3cdeaa041f28393a6cf504d1d9743a93e9bf060e5"} Jul 06 18:00:29.318768 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:29.318737 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" event={"ID":"8253379f-56c4-4e0d-be85-014c6a192341","Type":"ContainerStarted","Data":"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568"} Jul 06 18:00:29.319169 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:29.318866 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:29.349233 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:29.349149 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" podStartSLOduration=2.149968311 podStartE2EDuration="5.349128452s" totalImagesPullingTime="3.199160141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:29.346901526 +0000 UTC m=+522.835428628" watchObservedRunningTime="2026-07-06 18:00:29.349128452 +0000 UTC m=+522.837655558" Jul 06 18:00:40.324347 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:40.324262 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:40.565987 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:40.565956 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:40.566190 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:40.566144 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" podUID="8253379f-56c4-4e0d-be85-014c6a192341" containerName="limitador" containerID="cri-o://4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568" gracePeriod=30 Jul 06 18:00:41.105966 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.105937 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:41.214999 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.214911 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slwxl\" (UniqueName: \"kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl\") pod \"8253379f-56c4-4e0d-be85-014c6a192341\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " Jul 06 18:00:41.214999 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.214950 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file\") pod \"8253379f-56c4-4e0d-be85-014c6a192341\" (UID: \"8253379f-56c4-4e0d-be85-014c6a192341\") " Jul 06 18:00:41.215323 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.215298 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file" (OuterVolumeSpecName: "config-file") pod "8253379f-56c4-4e0d-be85-014c6a192341" (UID: "8253379f-56c4-4e0d-be85-014c6a192341"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:00:41.216922 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.216891 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl" (OuterVolumeSpecName: "kube-api-access-slwxl") pod "8253379f-56c4-4e0d-be85-014c6a192341" (UID: "8253379f-56c4-4e0d-be85-014c6a192341"). InnerVolumeSpecName "kube-api-access-slwxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:41.315740 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.315693 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8253379f-56c4-4e0d-be85-014c6a192341-config-file\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:00:41.315740 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.315732 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slwxl\" (UniqueName: \"kubernetes.io/projected/8253379f-56c4-4e0d-be85-014c6a192341-kube-api-access-slwxl\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:00:41.379132 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.379098 2555 generic.go:356] "Generic (PLEG): container finished" podID="8253379f-56c4-4e0d-be85-014c6a192341" containerID="4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568" exitCode=0 Jul 06 18:00:41.379558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.379146 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" event={"ID":"8253379f-56c4-4e0d-be85-014c6a192341","Type":"ContainerDied","Data":"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568"} Jul 06 18:00:41.379558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.379149 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" Jul 06 18:00:41.379558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.379209 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6g6d6" event={"ID":"8253379f-56c4-4e0d-be85-014c6a192341","Type":"ContainerDied","Data":"f5d477a64f17da9360c520e3cdeaa041f28393a6cf504d1d9743a93e9bf060e5"} Jul 06 18:00:41.379558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.379230 2555 scope.go:117] "RemoveContainer" containerID="4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568" Jul 06 18:00:41.388331 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.388310 2555 scope.go:117] "RemoveContainer" containerID="4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568" Jul 06 18:00:41.388603 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:00:41.388585 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568\": container with ID starting with 4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568 not found: ID does not exist" containerID="4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568" Jul 06 18:00:41.388668 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.388609 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568"} err="failed to get container status \"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568\": rpc error: code = NotFound desc = could not find container \"4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568\": container with ID starting with 4f9240f03021cc13e3e5b5eeaf02b09daf21c570726b9d651138b18e5bf88568 not found: ID does not exist" Jul 06 18:00:41.400010 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.399978 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:41.402193 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:41.402172 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6g6d6"] Jul 06 18:00:43.034433 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:43.034387 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8253379f-56c4-4e0d-be85-014c6a192341" path="/var/lib/kubelet/pods/8253379f-56c4-4e0d-be85-014c6a192341/volumes" Jul 06 18:00:45.825198 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.825168 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ccmgl"] Jul 06 18:00:45.825594 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.825549 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8253379f-56c4-4e0d-be85-014c6a192341" containerName="limitador" Jul 06 18:00:45.825594 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.825562 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8253379f-56c4-4e0d-be85-014c6a192341" containerName="limitador" Jul 06 18:00:45.825665 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.825620 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8253379f-56c4-4e0d-be85-014c6a192341" containerName="limitador" Jul 06 18:00:45.830114 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.830091 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:45.832789 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.832767 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 18:00:45.832949 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.832931 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z89lf\"" Jul 06 18:00:45.840288 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.840261 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ccmgl"] Jul 06 18:00:45.958258 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.958223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-data\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:45.958475 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:45.958294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx28\" (UniqueName: \"kubernetes.io/projected/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-kube-api-access-clx28\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.059416 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.059382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-data\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.059628 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.059477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clx28\" (UniqueName: \"kubernetes.io/projected/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-kube-api-access-clx28\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.059806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.059781 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-data\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.068761 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.068735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx28\" (UniqueName: \"kubernetes.io/projected/f0a8d39b-83d8-4c4e-a30d-4a18ceea5460-kube-api-access-clx28\") pod \"postgres-69fb4594cf-ccmgl\" (UID: \"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460\") " pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.142356 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.142274 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:46.273975 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.273950 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ccmgl"] Jul 06 18:00:46.275818 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:00:46.275791 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a8d39b_83d8_4c4e_a30d_4a18ceea5460.slice/crio-b7c58237471220ba8edfc8c9ae47a89072cbb34bf602425c9878167463005561 WatchSource:0}: Error finding container b7c58237471220ba8edfc8c9ae47a89072cbb34bf602425c9878167463005561: Status 404 returned error can't find the container with id b7c58237471220ba8edfc8c9ae47a89072cbb34bf602425c9878167463005561 Jul 06 18:00:46.403775 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:46.403699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ccmgl" event={"ID":"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460","Type":"ContainerStarted","Data":"b7c58237471220ba8edfc8c9ae47a89072cbb34bf602425c9878167463005561"} Jul 06 18:00:50.773764 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:50.773743 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 18:00:51.432058 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:51.432016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ccmgl" event={"ID":"f0a8d39b-83d8-4c4e-a30d-4a18ceea5460","Type":"ContainerStarted","Data":"66c01eee7e9ec3365f4cffd08a5324c00b85cde9d30f15d72d21ac5b24bf4c9c"} Jul 06 18:00:51.432256 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:51.432159 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:00:51.450515 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:51.450465 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ccmgl" podStartSLOduration=1.9566308540000001 podStartE2EDuration="6.450449889s" totalImagesPullingTime="4.493819035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:51.448530523 +0000 UTC m=+544.937057628" watchObservedRunningTime="2026-07-06 18:00:51.450449889 +0000 UTC m=+544.938976993" Jul 06 18:00:57.466853 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:00:57.466823 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ccmgl" Jul 06 18:01:05.479837 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.479806 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:05.503508 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.503479 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:05.503667 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.503571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.507056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.507029 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 18:01:05.507056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.507045 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 18:01:05.507256 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.507029 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xlhtm\"" Jul 06 18:01:05.543540 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.543513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qjs\" (UniqueName: \"kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.543678 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.543556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.644870 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.644825 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qjs\" (UniqueName: \"kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.645043 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.644887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.647418 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.647387 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.655908 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.655884 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qjs\" (UniqueName: \"kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs\") pod \"maas-controller-75b64954d4-n9dtg\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.662414 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.662389 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:01:05.665098 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.665079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.679749 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.679728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:01:05.745565 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.745475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x24kx\" (UniqueName: \"kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.745565 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.745517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.815442 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.815390 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:05.846011 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.845983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x24kx\" (UniqueName: \"kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.846153 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.846020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.848382 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.848353 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.856437 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.856395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x24kx\" (UniqueName: \"kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx\") pod \"maas-controller-56d4ff89f9-c7m9p\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:05.951947 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.951922 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:05.953655 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:05.953628 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85bc5028_aa2f_4f37_8c1e_f4b03b348a65.slice/crio-d169470432f59f729850ee0d771762a11901cf3792c7632ed2332b2209265edd WatchSource:0}: Error finding container d169470432f59f729850ee0d771762a11901cf3792c7632ed2332b2209265edd: Status 404 returned error can't find the container with id d169470432f59f729850ee0d771762a11901cf3792c7632ed2332b2209265edd Jul 06 18:01:05.975565 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:05.975544 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:06.109018 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:06.108998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:01:06.111014 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:06.110990 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0eb719_082c_41fa_b21c_87ab105466cc.slice/crio-73b2472ebb1e4db2868409717a5ee8de484cb7333ab4d31ad5d0037153bcc86d WatchSource:0}: Error finding container 73b2472ebb1e4db2868409717a5ee8de484cb7333ab4d31ad5d0037153bcc86d: Status 404 returned error can't find the container with id 73b2472ebb1e4db2868409717a5ee8de484cb7333ab4d31ad5d0037153bcc86d Jul 06 18:01:06.504708 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:06.504674 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" event={"ID":"0b0eb719-082c-41fa-b21c-87ab105466cc","Type":"ContainerStarted","Data":"73b2472ebb1e4db2868409717a5ee8de484cb7333ab4d31ad5d0037153bcc86d"} Jul 06 18:01:06.505921 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:06.505897 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b64954d4-n9dtg" event={"ID":"85bc5028-aa2f-4f37-8c1e-f4b03b348a65","Type":"ContainerStarted","Data":"d169470432f59f729850ee0d771762a11901cf3792c7632ed2332b2209265edd"} Jul 06 18:01:09.524891 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.524856 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" event={"ID":"0b0eb719-082c-41fa-b21c-87ab105466cc","Type":"ContainerStarted","Data":"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c"} Jul 06 18:01:09.525370 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.524978 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:09.526417 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.526388 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b64954d4-n9dtg" event={"ID":"85bc5028-aa2f-4f37-8c1e-f4b03b348a65","Type":"ContainerStarted","Data":"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331"} Jul 06 18:01:09.526563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.526480 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:09.571201 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.571149 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" podStartSLOduration=2.000179316 podStartE2EDuration="4.571105076s" totalImagesPullingTime="2.57092576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:09.568596618 +0000 UTC m=+563.057123735" watchObservedRunningTime="2026-07-06 18:01:09.571105076 +0000 UTC m=+563.059632179" Jul 06 18:01:09.594307 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:09.594238 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b64954d4-n9dtg" podStartSLOduration=1.856586483 podStartE2EDuration="4.594219174s" totalImagesPullingTime="2.737632691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:09.593513307 +0000 UTC m=+563.082040413" watchObservedRunningTime="2026-07-06 18:01:09.594219174 +0000 UTC m=+563.082746280" Jul 06 18:01:20.541345 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:20.541314 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:20.542139 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:20.541715 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:01:20.736581 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:20.736548 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:20.736775 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:20.736755 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75b64954d4-n9dtg" podUID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" containerName="manager" containerID="cri-o://3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331" gracePeriod=30 Jul 06 18:01:20.982177 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:20.982150 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:21.091701 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.091670 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert\") pod \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " Jul 06 18:01:21.091892 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.091724 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59qjs\" (UniqueName: \"kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs\") pod \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\" (UID: \"85bc5028-aa2f-4f37-8c1e-f4b03b348a65\") " Jul 06 18:01:21.093866 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.093830 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "85bc5028-aa2f-4f37-8c1e-f4b03b348a65" (UID: "85bc5028-aa2f-4f37-8c1e-f4b03b348a65"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:01:21.093991 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.093927 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs" (OuterVolumeSpecName: "kube-api-access-59qjs") pod "85bc5028-aa2f-4f37-8c1e-f4b03b348a65" (UID: "85bc5028-aa2f-4f37-8c1e-f4b03b348a65"). InnerVolumeSpecName "kube-api-access-59qjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:01:21.193247 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.193165 2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-webhook-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:01:21.193247 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.193194 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59qjs\" (UniqueName: \"kubernetes.io/projected/85bc5028-aa2f-4f37-8c1e-f4b03b348a65-kube-api-access-59qjs\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:01:21.579370 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.579332 2555 generic.go:356] "Generic (PLEG): container finished" podID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" containerID="3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331" exitCode=0 Jul 06 18:01:21.579806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.579380 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b64954d4-n9dtg" Jul 06 18:01:21.579806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.579404 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b64954d4-n9dtg" event={"ID":"85bc5028-aa2f-4f37-8c1e-f4b03b348a65","Type":"ContainerDied","Data":"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331"} Jul 06 18:01:21.579806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.579484 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b64954d4-n9dtg" event={"ID":"85bc5028-aa2f-4f37-8c1e-f4b03b348a65","Type":"ContainerDied","Data":"d169470432f59f729850ee0d771762a11901cf3792c7632ed2332b2209265edd"} Jul 06 18:01:21.579806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.579516 2555 scope.go:117] "RemoveContainer" containerID="3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331" Jul 06 18:01:21.588528 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.588506 2555 scope.go:117] "RemoveContainer" containerID="3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331" Jul 06 18:01:21.588784 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:01:21.588767 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331\": container with ID starting with 3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331 not found: ID does not exist" containerID="3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331" Jul 06 18:01:21.588854 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.588792 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331"} err="failed to get container status \"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331\": rpc error: code = NotFound desc = could not find container \"3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331\": container with ID starting with 3079800d0b580b6aaf676135d6dbe4d5e6b572ef56377fb3ef86160e703ef331 not found: ID does not exist" Jul 06 18:01:21.602574 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.602546 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:21.609917 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:21.609897 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b64954d4-n9dtg"] Jul 06 18:01:23.034539 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:23.034511 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" path="/var/lib/kubelet/pods/85bc5028-aa2f-4f37-8c1e-f4b03b348a65/volumes" Jul 06 18:01:40.961486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.961446 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-67d7cfbf95-tvlm2"] Jul 06 18:01:40.961842 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.961800 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" containerName="manager" Jul 06 18:01:40.961842 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.961811 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" containerName="manager" Jul 06 18:01:40.961916 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.961884 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85bc5028-aa2f-4f37-8c1e-f4b03b348a65" containerName="manager" Jul 06 18:01:40.964780 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.964762 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:40.968196 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.968175 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 18:01:40.968304 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.968260 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wkkbb\"" Jul 06 18:01:40.979914 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:40.979894 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67d7cfbf95-tvlm2"] Jul 06 18:01:41.069568 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.069537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0202108e-5c7f-40df-a77d-79c65976c53b-openshift-service-ca\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.069723 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.069646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0202108e-5c7f-40df-a77d-79c65976c53b-maas-api-tls\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.069723 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.069672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99wd\" (UniqueName: \"kubernetes.io/projected/0202108e-5c7f-40df-a77d-79c65976c53b-kube-api-access-v99wd\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.170938 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.170900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0202108e-5c7f-40df-a77d-79c65976c53b-maas-api-tls\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.170938 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.170945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99wd\" (UniqueName: \"kubernetes.io/projected/0202108e-5c7f-40df-a77d-79c65976c53b-kube-api-access-v99wd\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.171188 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.171006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0202108e-5c7f-40df-a77d-79c65976c53b-openshift-service-ca\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.171771 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.171740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0202108e-5c7f-40df-a77d-79c65976c53b-openshift-service-ca\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.173341 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.173308 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0202108e-5c7f-40df-a77d-79c65976c53b-maas-api-tls\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.181052 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.181021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99wd\" (UniqueName: \"kubernetes.io/projected/0202108e-5c7f-40df-a77d-79c65976c53b-kube-api-access-v99wd\") pod \"maas-api-67d7cfbf95-tvlm2\" (UID: \"0202108e-5c7f-40df-a77d-79c65976c53b\") " pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.275576 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.275545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:41.437800 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.437774 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67d7cfbf95-tvlm2"] Jul 06 18:01:41.440275 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:41.440252 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0202108e_5c7f_40df_a77d_79c65976c53b.slice/crio-33a709ab568d8f5ff127c8e9d56ec52b97dc14be1760877ae22816b9d17a90af WatchSource:0}: Error finding container 33a709ab568d8f5ff127c8e9d56ec52b97dc14be1760877ae22816b9d17a90af: Status 404 returned error can't find the container with id 33a709ab568d8f5ff127c8e9d56ec52b97dc14be1760877ae22816b9d17a90af Jul 06 18:01:41.497241 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.497213 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8pf28"] Jul 06 18:01:41.501865 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.501830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.503812 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.503792 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-g6x5w"] Jul 06 18:01:41.504949 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.504921 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 18:01:41.505287 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.505270 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rgknv\"" Jul 06 18:01:41.506758 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.506740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.520975 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.520952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8pf28"] Jul 06 18:01:41.527065 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.526998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-g6x5w"] Jul 06 18:01:41.575403 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.575359 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/215d11ad-2eda-49ea-964a-292e6e98e47f-plugins-config-volume\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.575580 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.575469 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3fba72-621c-4fe8-bd52-08c9ec359619-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.575580 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.575522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q7kx\" (UniqueName: \"kubernetes.io/projected/215d11ad-2eda-49ea-964a-292e6e98e47f-kube-api-access-6q7kx\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.575580 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.575552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxr85\" (UniqueName: \"kubernetes.io/projected/fb3fba72-621c-4fe8-bd52-08c9ec359619-kube-api-access-nxr85\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.670197 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.670159 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" event={"ID":"0202108e-5c7f-40df-a77d-79c65976c53b","Type":"ContainerStarted","Data":"33a709ab568d8f5ff127c8e9d56ec52b97dc14be1760877ae22816b9d17a90af"} Jul 06 18:01:41.676702 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.676669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/215d11ad-2eda-49ea-964a-292e6e98e47f-plugins-config-volume\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.676833 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.676758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3fba72-621c-4fe8-bd52-08c9ec359619-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.676833 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.676816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q7kx\" (UniqueName: \"kubernetes.io/projected/215d11ad-2eda-49ea-964a-292e6e98e47f-kube-api-access-6q7kx\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.676951 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.676850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxr85\" (UniqueName: \"kubernetes.io/projected/fb3fba72-621c-4fe8-bd52-08c9ec359619-kube-api-access-nxr85\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.677338 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.677319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/215d11ad-2eda-49ea-964a-292e6e98e47f-plugins-config-volume\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.677530 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.677511 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3fba72-621c-4fe8-bd52-08c9ec359619-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.685733 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.685708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q7kx\" (UniqueName: \"kubernetes.io/projected/215d11ad-2eda-49ea-964a-292e6e98e47f-kube-api-access-6q7kx\") pod \"payload-processing-58f86c7798-g6x5w\" (UID: \"215d11ad-2eda-49ea-964a-292e6e98e47f\") " pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.685832 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.685763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxr85\" (UniqueName: \"kubernetes.io/projected/fb3fba72-621c-4fe8-bd52-08c9ec359619-kube-api-access-nxr85\") pod \"payload-pre-processing-7964457696-8pf28\" (UID: \"fb3fba72-621c-4fe8-bd52-08c9ec359619\") " pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.814236 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.814153 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:41.820260 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.820241 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:41.957973 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.957904 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8pf28"] Jul 06 18:01:41.960087 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:41.960064 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3fba72_621c_4fe8_bd52_08c9ec359619.slice/crio-2931cf5f64f15aae1f9cdc2f94b20178b707bdeaaa92833ac5d5ce56268025f3 WatchSource:0}: Error finding container 2931cf5f64f15aae1f9cdc2f94b20178b707bdeaaa92833ac5d5ce56268025f3: Status 404 returned error can't find the container with id 2931cf5f64f15aae1f9cdc2f94b20178b707bdeaaa92833ac5d5ce56268025f3 Jul 06 18:01:41.984210 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:41.984187 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-g6x5w"] Jul 06 18:01:41.987709 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:41.987670 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215d11ad_2eda_49ea_964a_292e6e98e47f.slice/crio-78f827d6724bb696651d40ed18388251d53f287001bf5b8eca3bd8af3a7b0e71 WatchSource:0}: Error finding container 78f827d6724bb696651d40ed18388251d53f287001bf5b8eca3bd8af3a7b0e71: Status 404 returned error can't find the container with id 78f827d6724bb696651d40ed18388251d53f287001bf5b8eca3bd8af3a7b0e71 Jul 06 18:01:42.679815 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:42.679745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" event={"ID":"215d11ad-2eda-49ea-964a-292e6e98e47f","Type":"ContainerStarted","Data":"78f827d6724bb696651d40ed18388251d53f287001bf5b8eca3bd8af3a7b0e71"} Jul 06 18:01:42.681297 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:42.681265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" event={"ID":"fb3fba72-621c-4fe8-bd52-08c9ec359619","Type":"ContainerStarted","Data":"2931cf5f64f15aae1f9cdc2f94b20178b707bdeaaa92833ac5d5ce56268025f3"} Jul 06 18:01:43.689592 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.689495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" event={"ID":"215d11ad-2eda-49ea-964a-292e6e98e47f","Type":"ContainerStarted","Data":"8ab32ac2e0ffb465541a99578a31889f021ff2a22e674683444bd10a8cf3f058"} Jul 06 18:01:43.689592 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.689585 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:43.691543 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.691517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" event={"ID":"fb3fba72-621c-4fe8-bd52-08c9ec359619","Type":"ContainerStarted","Data":"ed6068ab8b86dbbb980c9c9a71023900137689128dc16e08ec199305e337b88c"} Jul 06 18:01:43.691674 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.691569 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:43.693320 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.693295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" event={"ID":"0202108e-5c7f-40df-a77d-79c65976c53b","Type":"ContainerStarted","Data":"80969fefad4723b6f3d6489672406cef9873a6d98d15d79616bbcb1231ea9e35"} Jul 06 18:01:43.693479 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.693458 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:43.710867 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.710821 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" podStartSLOduration=1.303783203 podStartE2EDuration="2.710805705s" totalImagesPullingTime="1.407022502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:43.709277662 +0000 UTC m=+597.197804768" watchObservedRunningTime="2026-07-06 18:01:43.710805705 +0000 UTC m=+597.199332808" Jul 06 18:01:43.729944 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.729900 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" podStartSLOduration=1.774261321 podStartE2EDuration="3.729885205s" totalImagesPullingTime="1.955623884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:43.72758958 +0000 UTC m=+597.216116687" watchObservedRunningTime="2026-07-06 18:01:43.729885205 +0000 UTC m=+597.218412309" Jul 06 18:01:43.747450 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:43.747390 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" podStartSLOduration=1.313564055 podStartE2EDuration="2.747376196s" totalImagesPullingTime="1.433812141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:43.746519317 +0000 UTC m=+597.235046422" watchObservedRunningTime="2026-07-06 18:01:43.747376196 +0000 UTC m=+597.235903299" Jul 06 18:01:49.705877 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:49.705848 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-67d7cfbf95-tvlm2" Jul 06 18:01:54.701488 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:54.701441 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-g6x5w" Jul 06 18:01:54.702023 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:54.701523 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8pf28" Jul 06 18:01:57.400279 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.400242 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96"] Jul 06 18:01:57.405498 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.405478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.408300 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.408280 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 18:01:57.409493 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.409466 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 18:01:57.409582 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.409503 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l6szp\"" Jul 06 18:01:57.409582 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.409508 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 18:01:57.417093 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.417071 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96"] Jul 06 18:01:57.522263 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.522486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.522486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.522486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.522669 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.522669 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.522538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpprk\" (UniqueName: \"kubernetes.io/projected/155bfb20-960e-4bfe-8d1c-cd044b7b899e-kube-api-access-kpprk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623381 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623381 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpprk\" (UniqueName: \"kubernetes.io/projected/155bfb20-960e-4bfe-8d1c-cd044b7b899e-kube-api-access-kpprk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623599 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623599 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623599 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623599 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623574 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623856 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.623995 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.623977 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.624053 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.624032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.625787 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.625767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/155bfb20-960e-4bfe-8d1c-cd044b7b899e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.626016 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.626000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/155bfb20-960e-4bfe-8d1c-cd044b7b899e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.634720 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.634697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpprk\" (UniqueName: \"kubernetes.io/projected/155bfb20-960e-4bfe-8d1c-cd044b7b899e-kube-api-access-kpprk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96\" (UID: \"155bfb20-960e-4bfe-8d1c-cd044b7b899e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.715771 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.715687 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:01:57.849054 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:57.849033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96"] Jul 06 18:01:57.850771 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:01:57.850745 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155bfb20_960e_4bfe_8d1c_cd044b7b899e.slice/crio-174d7928a00b2ad6c34bac30dff7a42b7769b901276685374016f231bd63c372 WatchSource:0}: Error finding container 174d7928a00b2ad6c34bac30dff7a42b7769b901276685374016f231bd63c372: Status 404 returned error can't find the container with id 174d7928a00b2ad6c34bac30dff7a42b7769b901276685374016f231bd63c372 Jul 06 18:01:58.764773 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:58.764734 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" event={"ID":"155bfb20-960e-4bfe-8d1c-cd044b7b899e","Type":"ContainerStarted","Data":"174d7928a00b2ad6c34bac30dff7a42b7769b901276685374016f231bd63c372"} Jul 06 18:01:59.771021 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:59.770984 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" event={"ID":"155bfb20-960e-4bfe-8d1c-cd044b7b899e","Type":"ContainerStarted","Data":"58feace7954a539ecb4382d36193a5dce1f52a215b0845db342b72c30afde73e"} Jul 06 18:01:59.791192 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:01:59.791145 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" podStartSLOduration=1.623039465 podStartE2EDuration="2.791126265s" totalImagesPullingTime="1.1680868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:59.790093166 +0000 UTC m=+613.278620273" watchObservedRunningTime="2026-07-06 18:01:59.791126265 +0000 UTC m=+613.279653368" Jul 06 18:02:07.716306 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:07.716268 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:02:07.716826 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:07.716366 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:02:07.728702 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:07.728674 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:02:07.818049 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:07.818022 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96" Jul 06 18:02:53.098737 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.098708 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7"] Jul 06 18:02:53.102760 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.102740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.105261 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.105241 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 18:02:53.114560 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.114538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7"] Jul 06 18:02:53.225960 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.225916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245820c3-27d1-4acf-b146-e330dca6b60d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.226146 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.226049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.226146 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.226107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.226146 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.226138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.226282 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.226198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.226282 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.226233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xt7d\" (UniqueName: \"kubernetes.io/projected/245820c3-27d1-4acf-b146-e330dca6b60d-kube-api-access-2xt7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327392 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xt7d\" (UniqueName: \"kubernetes.io/projected/245820c3-27d1-4acf-b146-e330dca6b60d-kube-api-access-2xt7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327585 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327412 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245820c3-27d1-4acf-b146-e330dca6b60d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327585 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327585 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327585 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327585 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327570 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.327941 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.328011 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.327981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.328070 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.328019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.329672 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.329644 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/245820c3-27d1-4acf-b146-e330dca6b60d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.329898 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.329875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245820c3-27d1-4acf-b146-e330dca6b60d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.335804 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.335780 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xt7d\" (UniqueName: \"kubernetes.io/projected/245820c3-27d1-4acf-b146-e330dca6b60d-kube-api-access-2xt7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cwc7\" (UID: \"245820c3-27d1-4acf-b146-e330dca6b60d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.414280 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.414182 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:02:53.548185 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.548158 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7"] Jul 06 18:02:53.549790 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:02:53.549760 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245820c3_27d1_4acf_b146_e330dca6b60d.slice/crio-024284eaa3e25c2f13a107644180ae960d68d4721ba4eb4bdf2328538c981a9e WatchSource:0}: Error finding container 024284eaa3e25c2f13a107644180ae960d68d4721ba4eb4bdf2328538c981a9e: Status 404 returned error can't find the container with id 024284eaa3e25c2f13a107644180ae960d68d4721ba4eb4bdf2328538c981a9e Jul 06 18:02:53.551068 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:53.551045 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:02:54.016641 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:54.016605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" event={"ID":"245820c3-27d1-4acf-b146-e330dca6b60d","Type":"ContainerStarted","Data":"2291614988e6b37bdd06c5de9014911fada2ad5991cc29ec73fec97186dca508"} Jul 06 18:02:54.016846 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:54.016671 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" event={"ID":"245820c3-27d1-4acf-b146-e330dca6b60d","Type":"ContainerStarted","Data":"024284eaa3e25c2f13a107644180ae960d68d4721ba4eb4bdf2328538c981a9e"} Jul 06 18:02:54.037278 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:02:54.037226 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" podStartSLOduration=0.750167307 podStartE2EDuration="1.037209497s" totalImagesPullingTime="287.04219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:02:54.037203078 +0000 UTC m=+667.525730181" watchObservedRunningTime="2026-07-06 18:02:54.037209497 +0000 UTC m=+667.525736601" Jul 06 18:03:03.414954 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:03:03.414916 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:03:03.415486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:03:03.414987 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:03:03.427921 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:03:03.427891 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:03:04.080662 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:03:04.080633 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cwc7" Jul 06 18:05:48.438404 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.438368 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:05:48.439091 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.438681 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" podUID="0b0eb719-082c-41fa-b21c-87ab105466cc" containerName="manager" containerID="cri-o://66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c" gracePeriod=30 Jul 06 18:05:48.691686 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.691618 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:05:48.767655 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.767618 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x24kx\" (UniqueName: \"kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx\") pod \"0b0eb719-082c-41fa-b21c-87ab105466cc\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " Jul 06 18:05:48.767819 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.767684 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert\") pod \"0b0eb719-082c-41fa-b21c-87ab105466cc\" (UID: \"0b0eb719-082c-41fa-b21c-87ab105466cc\") " Jul 06 18:05:48.769741 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.769704 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0b0eb719-082c-41fa-b21c-87ab105466cc" (UID: "0b0eb719-082c-41fa-b21c-87ab105466cc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:05:48.769869 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.769793 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx" (OuterVolumeSpecName: "kube-api-access-x24kx") pod "0b0eb719-082c-41fa-b21c-87ab105466cc" (UID: "0b0eb719-082c-41fa-b21c-87ab105466cc"). InnerVolumeSpecName "kube-api-access-x24kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:48.833314 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.833278 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b0eb719-082c-41fa-b21c-87ab105466cc" containerID="66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c" exitCode=0 Jul 06 18:05:48.833517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.833323 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" Jul 06 18:05:48.833517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.833366 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" event={"ID":"0b0eb719-082c-41fa-b21c-87ab105466cc","Type":"ContainerDied","Data":"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c"} Jul 06 18:05:48.833517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.833415 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-c7m9p" event={"ID":"0b0eb719-082c-41fa-b21c-87ab105466cc","Type":"ContainerDied","Data":"73b2472ebb1e4db2868409717a5ee8de484cb7333ab4d31ad5d0037153bcc86d"} Jul 06 18:05:48.833517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.833465 2555 scope.go:117] "RemoveContainer" containerID="66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c" Jul 06 18:05:48.842870 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.842850 2555 scope.go:117] "RemoveContainer" containerID="66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c" Jul 06 18:05:48.843165 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:05:48.843142 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c\": container with ID starting with 66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c not found: ID does not exist" containerID="66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c" Jul 06 18:05:48.843262 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.843171 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c"} err="failed to get container status \"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c\": rpc error: code = NotFound desc = could not find container \"66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c\": container with ID starting with 66ff3532664432e2ebb24dfb49eda9c90ed380e2779ef20c46eb8256d30f5c0c not found: ID does not exist" Jul 06 18:05:48.859880 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.859845 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:05:48.862319 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.862295 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-c7m9p"] Jul 06 18:05:48.868863 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.868840 2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0eb719-082c-41fa-b21c-87ab105466cc-webhook-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:05:48.868863 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:48.868863 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x24kx\" (UniqueName: \"kubernetes.io/projected/0b0eb719-082c-41fa-b21c-87ab105466cc-kube-api-access-x24kx\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.034558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.034526 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0eb719-082c-41fa-b21c-87ab105466cc" path="/var/lib/kubelet/pods/0b0eb719-082c-41fa-b21c-87ab105466cc/volumes" Jul 06 18:05:49.665013 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.664982 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-6mgdb"] Jul 06 18:05:49.665396 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.665354 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0eb719-082c-41fa-b21c-87ab105466cc" containerName="manager" Jul 06 18:05:49.665396 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.665365 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0eb719-082c-41fa-b21c-87ab105466cc" containerName="manager" Jul 06 18:05:49.665491 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.665449 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b0eb719-082c-41fa-b21c-87ab105466cc" containerName="manager" Jul 06 18:05:49.669765 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.669746 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.673386 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.673369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 18:05:49.673537 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.673472 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 18:05:49.673537 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.673495 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xlhtm\"" Jul 06 18:05:49.679710 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.679690 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-6mgdb"] Jul 06 18:05:49.778301 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.778263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ldg\" (UniqueName: \"kubernetes.io/projected/03a3b048-51db-4529-b918-6ce170a7e65b-kube-api-access-p7ldg\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.778516 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.778387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a3b048-51db-4529-b918-6ce170a7e65b-webhook-cert\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.879760 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.879720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a3b048-51db-4529-b918-6ce170a7e65b-webhook-cert\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.879953 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.879797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ldg\" (UniqueName: \"kubernetes.io/projected/03a3b048-51db-4529-b918-6ce170a7e65b-kube-api-access-p7ldg\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.882236 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.882204 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a3b048-51db-4529-b918-6ce170a7e65b-webhook-cert\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.889384 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.889358 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ldg\" (UniqueName: \"kubernetes.io/projected/03a3b048-51db-4529-b918-6ce170a7e65b-kube-api-access-p7ldg\") pod \"maas-controller-56d4ff89f9-6mgdb\" (UID: \"03a3b048-51db-4529-b918-6ce170a7e65b\") " pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:49.980627 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:49.980534 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:50.114849 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:50.114821 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d4ff89f9-6mgdb"] Jul 06 18:05:50.116574 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:05:50.116549 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a3b048_51db_4529_b918_6ce170a7e65b.slice/crio-bae65b7937af99c2a635f2649a3d8adfeb79bdb538b76a1f76df45ae61f4559e WatchSource:0}: Error finding container bae65b7937af99c2a635f2649a3d8adfeb79bdb538b76a1f76df45ae61f4559e: Status 404 returned error can't find the container with id bae65b7937af99c2a635f2649a3d8adfeb79bdb538b76a1f76df45ae61f4559e Jul 06 18:05:50.846483 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:50.846449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" event={"ID":"03a3b048-51db-4529-b918-6ce170a7e65b","Type":"ContainerStarted","Data":"6e4402d7998f6ac22b50cd748fee4015b6e9029fc2f989b386d5ddc5f8bb2442"} Jul 06 18:05:50.846879 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:50.846498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" event={"ID":"03a3b048-51db-4529-b918-6ce170a7e65b","Type":"ContainerStarted","Data":"bae65b7937af99c2a635f2649a3d8adfeb79bdb538b76a1f76df45ae61f4559e"} Jul 06 18:05:50.846879 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:50.846542 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:05:50.877601 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:05:50.877498 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" podStartSLOduration=1.2305433940000001 podStartE2EDuration="1.877479341s" totalImagesPullingTime="646.935947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:05:50.876311734 +0000 UTC m=+844.364838838" watchObservedRunningTime="2026-07-06 18:05:50.877479341 +0000 UTC m=+844.366006455" Jul 06 18:06:01.858308 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:06:01.858278 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56d4ff89f9-6mgdb" Jul 06 18:07:28.310839 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:28.310805 2555 generic.go:356] "Generic (PLEG): container finished" podID="601a1bf3-157e-4829-b346-7c678d4846c9" containerID="903fe2e3ae2a20603a00704b3cdd3b9ccd4b6864000dc661d3a569357a5471ca" exitCode=1 Jul 06 18:07:28.313108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:28.310889 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" event={"ID":"601a1bf3-157e-4829-b346-7c678d4846c9","Type":"ContainerDied","Data":"903fe2e3ae2a20603a00704b3cdd3b9ccd4b6864000dc661d3a569357a5471ca"} Jul 06 18:07:28.313108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:28.311293 2555 scope.go:117] "RemoveContainer" containerID="903fe2e3ae2a20603a00704b3cdd3b9ccd4b6864000dc661d3a569357a5471ca" Jul 06 18:07:29.318637 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:29.318603 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" event={"ID":"601a1bf3-157e-4829-b346-7c678d4846c9","Type":"ContainerStarted","Data":"4258cf85c8c4226d0e8fe62e88bae4f4cc973ea66c45c04989cc2d22dfd492eb"} Jul 06 18:07:29.319051 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:29.318811 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 18:07:40.327825 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:07:40.327796 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-88fc8bffd-59qlx" Jul 06 18:18:27.514725 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.514691 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:27.518508 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.518486 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.521372 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.521347 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-341d8081-serving-cert\"" Jul 06 18:18:27.529847 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.529825 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:27.686786 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.686749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.686944 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.686810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.686944 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.686867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfm9s\" (UniqueName: \"kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.787517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.787402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.787517 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.787513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.787709 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.787539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfm9s\" (UniqueName: \"kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.787709 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:18:27.787687 2555 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-341d8081-serving-cert: secret "maas-api-e2e-ait-341d8081-serving-cert" not found Jul 06 18:18:27.787783 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:18:27.787773 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls podName:67eff9e5-7623-447c-aac4-fa3518f5c477 nodeName:}" failed. No retries permitted until 2026-07-06 18:18:28.28775149 +0000 UTC m=+1601.776278580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls") pod "maas-api-e2e-ait-341d8081-56c856f457-wqhzj" (UID: "67eff9e5-7623-447c-aac4-fa3518f5c477") : secret "maas-api-e2e-ait-341d8081-serving-cert" not found Jul 06 18:18:27.788169 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.788151 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:27.797383 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:27.797357 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfm9s\" (UniqueName: \"kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:28.292503 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:28.292470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:28.294887 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:28.294855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") pod \"maas-api-e2e-ait-341d8081-56c856f457-wqhzj\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:28.429834 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:28.429799 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:28.575661 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:28.575637 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:28.577369 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:18:28.577341 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67eff9e5_7623_447c_aac4_fa3518f5c477.slice/crio-2a9af4f17422592da0b1545a170a8fb36b90da592149040432c9d3024061d7bc WatchSource:0}: Error finding container 2a9af4f17422592da0b1545a170a8fb36b90da592149040432c9d3024061d7bc: Status 404 returned error can't find the container with id 2a9af4f17422592da0b1545a170a8fb36b90da592149040432c9d3024061d7bc Jul 06 18:18:28.578730 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:28.578712 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:18:29.467327 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:29.467236 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" event={"ID":"67eff9e5-7623-447c-aac4-fa3518f5c477","Type":"ContainerStarted","Data":"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132"} Jul 06 18:18:29.467327 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:29.467296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" event={"ID":"67eff9e5-7623-447c-aac4-fa3518f5c477","Type":"ContainerStarted","Data":"2a9af4f17422592da0b1545a170a8fb36b90da592149040432c9d3024061d7bc"} Jul 06 18:18:29.467327 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:29.467325 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:29.498580 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:29.498527 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" podStartSLOduration=2.033860392 podStartE2EDuration="2.498511215s" totalImagesPullingTime="464.650823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:29.49812173 +0000 UTC m=+1602.986648834" watchObservedRunningTime="2026-07-06 18:18:29.498511215 +0000 UTC m=+1602.987038319" Jul 06 18:18:33.142980 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.142925 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:33.143503 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.143141 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" podUID="67eff9e5-7623-447c-aac4-fa3518f5c477" containerName="maas-api" containerID="cri-o://3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132" gracePeriod=30 Jul 06 18:18:33.392656 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.392630 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:33.440804 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.440717 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfm9s\" (UniqueName: \"kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s\") pod \"67eff9e5-7623-447c-aac4-fa3518f5c477\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " Jul 06 18:18:33.440957 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.440807 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") pod \"67eff9e5-7623-447c-aac4-fa3518f5c477\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " Jul 06 18:18:33.440957 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.440873 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca\") pod \"67eff9e5-7623-447c-aac4-fa3518f5c477\" (UID: \"67eff9e5-7623-447c-aac4-fa3518f5c477\") " Jul 06 18:18:33.441210 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.441183 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67eff9e5-7623-447c-aac4-fa3518f5c477" (UID: "67eff9e5-7623-447c-aac4-fa3518f5c477"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:18:33.442768 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.442735 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s" (OuterVolumeSpecName: "kube-api-access-nfm9s") pod "67eff9e5-7623-447c-aac4-fa3518f5c477" (UID: "67eff9e5-7623-447c-aac4-fa3518f5c477"). InnerVolumeSpecName "kube-api-access-nfm9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:33.442890 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.442800 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67eff9e5-7623-447c-aac4-fa3518f5c477" (UID: "67eff9e5-7623-447c-aac4-fa3518f5c477"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:18:33.488739 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.488711 2555 generic.go:356] "Generic (PLEG): container finished" podID="67eff9e5-7623-447c-aac4-fa3518f5c477" containerID="3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132" exitCode=0 Jul 06 18:18:33.488883 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.488752 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" Jul 06 18:18:33.488883 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.488797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" event={"ID":"67eff9e5-7623-447c-aac4-fa3518f5c477","Type":"ContainerDied","Data":"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132"} Jul 06 18:18:33.488883 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.488852 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj" event={"ID":"67eff9e5-7623-447c-aac4-fa3518f5c477","Type":"ContainerDied","Data":"2a9af4f17422592da0b1545a170a8fb36b90da592149040432c9d3024061d7bc"} Jul 06 18:18:33.488883 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.488881 2555 scope.go:117] "RemoveContainer" containerID="3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132" Jul 06 18:18:33.497696 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.497682 2555 scope.go:117] "RemoveContainer" containerID="3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132" Jul 06 18:18:33.497925 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:18:33.497907 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132\": container with ID starting with 3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132 not found: ID does not exist" containerID="3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132" Jul 06 18:18:33.497974 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.497933 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132"} err="failed to get container status \"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132\": rpc error: code = NotFound desc = could not find container \"3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132\": container with ID starting with 3871852f8567cfddbf112662d85bbd1959f20ee8d9a556fc6ececef1d15c2132 not found: ID does not exist" Jul 06 18:18:33.510323 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.510302 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:33.513850 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.513832 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-341d8081-56c856f457-wqhzj"] Jul 06 18:18:33.541527 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.541506 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfm9s\" (UniqueName: \"kubernetes.io/projected/67eff9e5-7623-447c-aac4-fa3518f5c477-kube-api-access-nfm9s\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:33.541619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.541529 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67eff9e5-7623-447c-aac4-fa3518f5c477-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:33.541619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:33.541540 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67eff9e5-7623-447c-aac4-fa3518f5c477-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:35.034527 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:35.034490 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67eff9e5-7623-447c-aac4-fa3518f5c477" path="/var/lib/kubelet/pods/67eff9e5-7623-447c-aac4-fa3518f5c477/volumes" Jul 06 18:18:40.893334 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.893298 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:40.893933 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.893915 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67eff9e5-7623-447c-aac4-fa3518f5c477" containerName="maas-api" Jul 06 18:18:40.894015 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.893935 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="67eff9e5-7623-447c-aac4-fa3518f5c477" containerName="maas-api" Jul 06 18:18:40.894068 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.894059 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="67eff9e5-7623-447c-aac4-fa3518f5c477" containerName="maas-api" Jul 06 18:18:40.899231 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.899210 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:40.901607 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.901588 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a68cb1d3-serving-cert\"" Jul 06 18:18:40.908123 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:40.907875 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:41.004348 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.004318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95kr\" (UniqueName: \"kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.004547 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.004379 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.004547 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.004496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.105564 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.105521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.105742 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.105585 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.105742 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.105665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95kr\" (UniqueName: \"kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.106229 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.106201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.108042 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.108015 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.114151 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.114126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95kr\" (UniqueName: \"kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr\") pod \"maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.212006 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.211911 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:41.347818 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.347793 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:41.350459 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:18:41.350408 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907ca07a_6ff0_42e9_ae03_47750db2b149.slice/crio-942a08990feba0900883b68381f81944be7e4c4948d5629f6b8f7e5b52d556b0 WatchSource:0}: Error finding container 942a08990feba0900883b68381f81944be7e4c4948d5629f6b8f7e5b52d556b0: Status 404 returned error can't find the container with id 942a08990feba0900883b68381f81944be7e4c4948d5629f6b8f7e5b52d556b0 Jul 06 18:18:41.535761 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:41.535730 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" event={"ID":"907ca07a-6ff0-42e9-ae03-47750db2b149","Type":"ContainerStarted","Data":"942a08990feba0900883b68381f81944be7e4c4948d5629f6b8f7e5b52d556b0"} Jul 06 18:18:42.542128 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:42.542094 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" event={"ID":"907ca07a-6ff0-42e9-ae03-47750db2b149","Type":"ContainerStarted","Data":"072e99554702beff309613dc357697454681b9767245eb01eb225b2dcd991095"} Jul 06 18:18:42.542651 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:42.542189 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:42.561087 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:42.561034 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" podStartSLOduration=2.246425023 podStartE2EDuration="2.561017562s" totalImagesPullingTime="314.592539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:42.559987237 +0000 UTC m=+1616.048514340" watchObservedRunningTime="2026-07-06 18:18:42.561017562 +0000 UTC m=+1616.049544666" Jul 06 18:18:46.355831 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.355791 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:46.356268 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.356058 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" podUID="907ca07a-6ff0-42e9-ae03-47750db2b149" containerName="maas-api" containerID="cri-o://072e99554702beff309613dc357697454681b9767245eb01eb225b2dcd991095" gracePeriod=30 Jul 06 18:18:46.362158 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.362136 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:46.564386 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.564355 2555 generic.go:356] "Generic (PLEG): container finished" podID="907ca07a-6ff0-42e9-ae03-47750db2b149" containerID="072e99554702beff309613dc357697454681b9767245eb01eb225b2dcd991095" exitCode=0 Jul 06 18:18:46.564547 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.564408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" event={"ID":"907ca07a-6ff0-42e9-ae03-47750db2b149","Type":"ContainerDied","Data":"072e99554702beff309613dc357697454681b9767245eb01eb225b2dcd991095"} Jul 06 18:18:46.614137 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.614077 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:46.659017 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.658990 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca\") pod \"907ca07a-6ff0-42e9-ae03-47750db2b149\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " Jul 06 18:18:46.659199 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.659025 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d95kr\" (UniqueName: \"kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr\") pod \"907ca07a-6ff0-42e9-ae03-47750db2b149\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " Jul 06 18:18:46.659199 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.659075 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls\") pod \"907ca07a-6ff0-42e9-ae03-47750db2b149\" (UID: \"907ca07a-6ff0-42e9-ae03-47750db2b149\") " Jul 06 18:18:46.659466 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.659410 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "907ca07a-6ff0-42e9-ae03-47750db2b149" (UID: "907ca07a-6ff0-42e9-ae03-47750db2b149"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:18:46.661220 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.661186 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr" (OuterVolumeSpecName: "kube-api-access-d95kr") pod "907ca07a-6ff0-42e9-ae03-47750db2b149" (UID: "907ca07a-6ff0-42e9-ae03-47750db2b149"). InnerVolumeSpecName "kube-api-access-d95kr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:46.661220 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.661213 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "907ca07a-6ff0-42e9-ae03-47750db2b149" (UID: "907ca07a-6ff0-42e9-ae03-47750db2b149"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:18:46.760619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.760579 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/907ca07a-6ff0-42e9-ae03-47750db2b149-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:46.760619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.760609 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d95kr\" (UniqueName: \"kubernetes.io/projected/907ca07a-6ff0-42e9-ae03-47750db2b149-kube-api-access-d95kr\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:46.760619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:46.760619 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/907ca07a-6ff0-42e9-ae03-47750db2b149-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:18:47.570792 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:47.570765 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" Jul 06 18:18:47.571203 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:47.570759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx" event={"ID":"907ca07a-6ff0-42e9-ae03-47750db2b149","Type":"ContainerDied","Data":"942a08990feba0900883b68381f81944be7e4c4948d5629f6b8f7e5b52d556b0"} Jul 06 18:18:47.571203 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:47.570916 2555 scope.go:117] "RemoveContainer" containerID="072e99554702beff309613dc357697454681b9767245eb01eb225b2dcd991095" Jul 06 18:18:47.589081 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:47.589045 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:47.593073 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:47.593049 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a68cb1d3-6758785bd8-c2vvx"] Jul 06 18:18:49.034558 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:49.034529 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907ca07a-6ff0-42e9-ae03-47750db2b149" path="/var/lib/kubelet/pods/907ca07a-6ff0-42e9-ae03-47750db2b149/volumes" Jul 06 18:18:59.782766 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.782734 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:18:59.783184 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.783143 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907ca07a-6ff0-42e9-ae03-47750db2b149" containerName="maas-api" Jul 06 18:18:59.783184 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.783158 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="907ca07a-6ff0-42e9-ae03-47750db2b149" containerName="maas-api" Jul 06 18:18:59.783253 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.783235 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="907ca07a-6ff0-42e9-ae03-47750db2b149" containerName="maas-api" Jul 06 18:18:59.787817 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.787794 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.791021 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.790995 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-bce7a316-serving-cert\"" Jul 06 18:18:59.811175 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.811145 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:18:59.886908 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.886872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.886908 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.886911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.887167 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.886962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hftd\" (UniqueName: \"kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.987841 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.987803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.987841 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.987842 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.988092 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.987971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hftd\" (UniqueName: \"kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.988566 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.988546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.990279 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.990256 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:18:59.997012 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:18:59.996989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hftd\" (UniqueName: \"kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd\") pod \"maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:19:00.098280 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:00.098192 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:19:00.237405 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:00.237377 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:19:00.238610 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:19:00.238583 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ccba23_55b2_4970_83ed_3d2e38a048d8.slice/crio-e88e36d3ab5c3b081e0344d438f66c7db5fb235e40d57b7df4c20ad5f9236932 WatchSource:0}: Error finding container e88e36d3ab5c3b081e0344d438f66c7db5fb235e40d57b7df4c20ad5f9236932: Status 404 returned error can't find the container with id e88e36d3ab5c3b081e0344d438f66c7db5fb235e40d57b7df4c20ad5f9236932 Jul 06 18:19:00.637409 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:00.637379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" event={"ID":"64ccba23-55b2-4970-83ed-3d2e38a048d8","Type":"ContainerStarted","Data":"e88e36d3ab5c3b081e0344d438f66c7db5fb235e40d57b7df4c20ad5f9236932"} Jul 06 18:19:01.643016 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:01.642981 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" event={"ID":"64ccba23-55b2-4970-83ed-3d2e38a048d8","Type":"ContainerStarted","Data":"25c6afcc97b0302b60bc620b4496c67717d56dcaf66a1a7286fe77854b3806bd"} Jul 06 18:19:01.643509 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:01.643108 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:19:01.664139 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:01.664087 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" podStartSLOduration=2.322134778 podStartE2EDuration="2.664071545s" totalImagesPullingTime="341.936767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:19:01.663117505 +0000 UTC m=+1635.151644610" watchObservedRunningTime="2026-07-06 18:19:01.664071545 +0000 UTC m=+1635.152598652" Jul 06 18:19:04.501970 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.501780 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:19:04.502443 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.502034 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" podUID="64ccba23-55b2-4970-83ed-3d2e38a048d8" containerName="maas-api" containerID="cri-o://25c6afcc97b0302b60bc620b4496c67717d56dcaf66a1a7286fe77854b3806bd" gracePeriod=30 Jul 06 18:19:04.659098 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.659066 2555 generic.go:356] "Generic (PLEG): container finished" podID="64ccba23-55b2-4970-83ed-3d2e38a048d8" containerID="25c6afcc97b0302b60bc620b4496c67717d56dcaf66a1a7286fe77854b3806bd" exitCode=0 Jul 06 18:19:04.659262 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.659133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" event={"ID":"64ccba23-55b2-4970-83ed-3d2e38a048d8","Type":"ContainerDied","Data":"25c6afcc97b0302b60bc620b4496c67717d56dcaf66a1a7286fe77854b3806bd"} Jul 06 18:19:04.757458 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.757381 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:19:04.835285 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.835254 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls\") pod \"64ccba23-55b2-4970-83ed-3d2e38a048d8\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " Jul 06 18:19:04.835466 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.835307 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hftd\" (UniqueName: \"kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd\") pod \"64ccba23-55b2-4970-83ed-3d2e38a048d8\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " Jul 06 18:19:04.835466 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.835329 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca\") pod \"64ccba23-55b2-4970-83ed-3d2e38a048d8\" (UID: \"64ccba23-55b2-4970-83ed-3d2e38a048d8\") " Jul 06 18:19:04.835734 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.835706 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64ccba23-55b2-4970-83ed-3d2e38a048d8" (UID: "64ccba23-55b2-4970-83ed-3d2e38a048d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:19:04.837417 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.837393 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64ccba23-55b2-4970-83ed-3d2e38a048d8" (UID: "64ccba23-55b2-4970-83ed-3d2e38a048d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:19:04.837524 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.837469 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd" (OuterVolumeSpecName: "kube-api-access-2hftd") pod "64ccba23-55b2-4970-83ed-3d2e38a048d8" (UID: "64ccba23-55b2-4970-83ed-3d2e38a048d8"). InnerVolumeSpecName "kube-api-access-2hftd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:04.936056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.936020 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hftd\" (UniqueName: \"kubernetes.io/projected/64ccba23-55b2-4970-83ed-3d2e38a048d8-kube-api-access-2hftd\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:19:04.936056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.936051 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ccba23-55b2-4970-83ed-3d2e38a048d8-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:19:04.936056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:04.936066 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64ccba23-55b2-4970-83ed-3d2e38a048d8-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:19:05.664942 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:05.664907 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" Jul 06 18:19:05.664942 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:05.664921 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7" event={"ID":"64ccba23-55b2-4970-83ed-3d2e38a048d8","Type":"ContainerDied","Data":"e88e36d3ab5c3b081e0344d438f66c7db5fb235e40d57b7df4c20ad5f9236932"} Jul 06 18:19:05.665454 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:05.665006 2555 scope.go:117] "RemoveContainer" containerID="25c6afcc97b0302b60bc620b4496c67717d56dcaf66a1a7286fe77854b3806bd" Jul 06 18:19:05.682340 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:05.682311 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:19:05.686912 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:05.686885 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-bce7a316-5fc45bdfb9-pfkd7"] Jul 06 18:19:07.035004 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:19:07.034973 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64ccba23-55b2-4970-83ed-3d2e38a048d8" path="/var/lib/kubelet/pods/64ccba23-55b2-4970-83ed-3d2e38a048d8/volumes" Jul 06 18:20:51.647139 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.647107 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:20:51.647732 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.647716 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64ccba23-55b2-4970-83ed-3d2e38a048d8" containerName="maas-api" Jul 06 18:20:51.647777 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.647734 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ccba23-55b2-4970-83ed-3d2e38a048d8" containerName="maas-api" Jul 06 18:20:51.647853 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.647842 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="64ccba23-55b2-4970-83ed-3d2e38a048d8" containerName="maas-api" Jul 06 18:20:51.651292 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.651267 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.654053 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.654033 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-084930c2-serving-cert\"" Jul 06 18:20:51.659950 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.659832 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:20:51.809994 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.809962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.809994 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.809995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5549\" (UniqueName: \"kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.810219 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.810088 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.911668 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.911573 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.911844 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.911700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.911844 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.911732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5549\" (UniqueName: \"kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.912220 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.912198 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.914234 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.914210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.921942 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.921918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5549\" (UniqueName: \"kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549\") pod \"maas-api-e2e-mt-084930c2-7d45c5876-srj2k\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:51.964590 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:51.964556 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:52.108962 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:52.108941 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:20:52.112078 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:20:52.112046 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee837e05_1a91_4305_91f4_2ccc2d22435e.slice/crio-7dfe8b5dc859cce8173bedf905854ddf9ea096d7b39cef262ff01fa7f4d7bc99 WatchSource:0}: Error finding container 7dfe8b5dc859cce8173bedf905854ddf9ea096d7b39cef262ff01fa7f4d7bc99: Status 404 returned error can't find the container with id 7dfe8b5dc859cce8173bedf905854ddf9ea096d7b39cef262ff01fa7f4d7bc99 Jul 06 18:20:52.179442 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:52.179314 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" event={"ID":"ee837e05-1a91-4305-91f4-2ccc2d22435e","Type":"ContainerStarted","Data":"7dfe8b5dc859cce8173bedf905854ddf9ea096d7b39cef262ff01fa7f4d7bc99"} Jul 06 18:20:53.185600 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:53.185567 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" event={"ID":"ee837e05-1a91-4305-91f4-2ccc2d22435e","Type":"ContainerStarted","Data":"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8"} Jul 06 18:20:53.186089 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:53.185662 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:20:53.203536 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:53.203490 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" podStartSLOduration=1.8127133720000002 podStartE2EDuration="2.203470207s" totalImagesPullingTime="390.756835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:53.202527492 +0000 UTC m=+1746.691054598" watchObservedRunningTime="2026-07-06 18:20:53.203470207 +0000 UTC m=+1746.691997316" Jul 06 18:20:59.195233 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:20:59.195208 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:21:04.563238 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.563198 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:21:04.563699 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.563450 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" podUID="ee837e05-1a91-4305-91f4-2ccc2d22435e" containerName="maas-api" containerID="cri-o://d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8" gracePeriod=30 Jul 06 18:21:04.808283 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.808262 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:21:04.931013 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.930931 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls\") pod \"ee837e05-1a91-4305-91f4-2ccc2d22435e\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " Jul 06 18:21:04.931013 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.930972 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca\") pod \"ee837e05-1a91-4305-91f4-2ccc2d22435e\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " Jul 06 18:21:04.931231 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.931025 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5549\" (UniqueName: \"kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549\") pod \"ee837e05-1a91-4305-91f4-2ccc2d22435e\" (UID: \"ee837e05-1a91-4305-91f4-2ccc2d22435e\") " Jul 06 18:21:04.931349 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.931322 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee837e05-1a91-4305-91f4-2ccc2d22435e" (UID: "ee837e05-1a91-4305-91f4-2ccc2d22435e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:21:04.932959 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.932921 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee837e05-1a91-4305-91f4-2ccc2d22435e" (UID: "ee837e05-1a91-4305-91f4-2ccc2d22435e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:21:04.933072 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:04.933035 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549" (OuterVolumeSpecName: "kube-api-access-l5549") pod "ee837e05-1a91-4305-91f4-2ccc2d22435e" (UID: "ee837e05-1a91-4305-91f4-2ccc2d22435e"). InnerVolumeSpecName "kube-api-access-l5549". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:05.031753 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.031718 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee837e05-1a91-4305-91f4-2ccc2d22435e-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:21:05.031753 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.031751 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee837e05-1a91-4305-91f4-2ccc2d22435e-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:21:05.031753 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.031762 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5549\" (UniqueName: \"kubernetes.io/projected/ee837e05-1a91-4305-91f4-2ccc2d22435e-kube-api-access-l5549\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:21:05.250190 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.250104 2555 generic.go:356] "Generic (PLEG): container finished" podID="ee837e05-1a91-4305-91f4-2ccc2d22435e" containerID="d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8" exitCode=0 Jul 06 18:21:05.250190 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.250153 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" Jul 06 18:21:05.250364 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.250194 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" event={"ID":"ee837e05-1a91-4305-91f4-2ccc2d22435e","Type":"ContainerDied","Data":"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8"} Jul 06 18:21:05.250364 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.250249 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k" event={"ID":"ee837e05-1a91-4305-91f4-2ccc2d22435e","Type":"ContainerDied","Data":"7dfe8b5dc859cce8173bedf905854ddf9ea096d7b39cef262ff01fa7f4d7bc99"} Jul 06 18:21:05.250364 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.250278 2555 scope.go:117] "RemoveContainer" containerID="d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8" Jul 06 18:21:05.258724 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.258707 2555 scope.go:117] "RemoveContainer" containerID="d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8" Jul 06 18:21:05.259016 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:21:05.258988 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8\": container with ID starting with d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8 not found: ID does not exist" containerID="d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8" Jul 06 18:21:05.259113 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.259019 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8"} err="failed to get container status \"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8\": rpc error: code = NotFound desc = could not find container \"d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8\": container with ID starting with d00b6954b3651b42235b723477516ec0dccfff12fb18d7363cf02299df126de8 not found: ID does not exist" Jul 06 18:21:05.266013 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.265990 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:21:05.270262 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:05.270242 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-084930c2-7d45c5876-srj2k"] Jul 06 18:21:07.035582 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:07.035548 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee837e05-1a91-4305-91f4-2ccc2d22435e" path="/var/lib/kubelet/pods/ee837e05-1a91-4305-91f4-2ccc2d22435e/volumes" Jul 06 18:21:34.935903 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.935869 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:21:34.936498 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.936296 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee837e05-1a91-4305-91f4-2ccc2d22435e" containerName="maas-api" Jul 06 18:21:34.936498 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.936312 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee837e05-1a91-4305-91f4-2ccc2d22435e" containerName="maas-api" Jul 06 18:21:34.936498 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.936476 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee837e05-1a91-4305-91f4-2ccc2d22435e" containerName="maas-api" Jul 06 18:21:34.940255 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.940238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:34.943184 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.943161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-12711072-serving-cert\"" Jul 06 18:21:34.950048 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:34.950014 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:21:35.114567 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.114532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.114762 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.114575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.114762 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.114675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4std\" (UniqueName: \"kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.215495 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.215377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.215495 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.215442 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.215684 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.215507 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4std\" (UniqueName: \"kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.216092 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.216073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.217860 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.217832 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.222967 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.222946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4std\" (UniqueName: \"kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std\") pod \"maas-api-e2e-mt-12711072-68cf78d85d-n66fv\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.251851 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.251823 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:35.390997 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:35.390967 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:21:35.392603 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:21:35.392561 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd4e443_802d_4fbb_afd4_89cd30d9aa21.slice/crio-bd10e28f83a1abedec9dd49f34d3c0ffa32f3679084af4cdcffdef2d96615180 WatchSource:0}: Error finding container bd10e28f83a1abedec9dd49f34d3c0ffa32f3679084af4cdcffdef2d96615180: Status 404 returned error can't find the container with id bd10e28f83a1abedec9dd49f34d3c0ffa32f3679084af4cdcffdef2d96615180 Jul 06 18:21:36.403853 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:36.403817 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" event={"ID":"abd4e443-802d-4fbb-afd4-89cd30d9aa21","Type":"ContainerStarted","Data":"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961"} Jul 06 18:21:36.404340 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:36.403905 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" event={"ID":"abd4e443-802d-4fbb-afd4-89cd30d9aa21","Type":"ContainerStarted","Data":"bd10e28f83a1abedec9dd49f34d3c0ffa32f3679084af4cdcffdef2d96615180"} Jul 06 18:21:36.404340 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:36.403935 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:21:36.423063 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:36.423016 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" podStartSLOduration=2.076860931 podStartE2EDuration="2.4230002s" totalImagesPullingTime="346.139269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:21:36.421123687 +0000 UTC m=+1789.909650792" watchObservedRunningTime="2026-07-06 18:21:36.4230002 +0000 UTC m=+1789.911527303" Jul 06 18:21:42.414563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:21:42.414491 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:22:17.280322 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.280287 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:22:17.280922 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.280569 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerName="maas-api" containerID="cri-o://0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961" gracePeriod=30 Jul 06 18:22:17.410238 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.410191 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.43:8443/health\": dial tcp 10.133.0.43:8443: connect: connection refused" Jul 06 18:22:17.532052 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.531986 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:22:17.605701 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.605663 2555 generic.go:356] "Generic (PLEG): container finished" podID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerID="0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961" exitCode=0 Jul 06 18:22:17.605892 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.605716 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" Jul 06 18:22:17.605892 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.605761 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" event={"ID":"abd4e443-802d-4fbb-afd4-89cd30d9aa21","Type":"ContainerDied","Data":"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961"} Jul 06 18:22:17.605892 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.605823 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv" event={"ID":"abd4e443-802d-4fbb-afd4-89cd30d9aa21","Type":"ContainerDied","Data":"bd10e28f83a1abedec9dd49f34d3c0ffa32f3679084af4cdcffdef2d96615180"} Jul 06 18:22:17.605892 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.605854 2555 scope.go:117] "RemoveContainer" containerID="0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961" Jul 06 18:22:17.614554 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.614533 2555 scope.go:117] "RemoveContainer" containerID="0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961" Jul 06 18:22:17.614815 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:22:17.614798 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961\": container with ID starting with 0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961 not found: ID does not exist" containerID="0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961" Jul 06 18:22:17.614900 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.614827 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961"} err="failed to get container status \"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961\": rpc error: code = NotFound desc = could not find container \"0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961\": container with ID starting with 0dd9c20b31bbdb58ff2975f2d525d30d2e3dd0362ed9d6ae1ed94ffc302be961 not found: ID does not exist" Jul 06 18:22:17.697505 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.697474 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls\") pod \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " Jul 06 18:22:17.697680 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.697571 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4std\" (UniqueName: \"kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std\") pod \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " Jul 06 18:22:17.697680 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.697616 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca\") pod \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\" (UID: \"abd4e443-802d-4fbb-afd4-89cd30d9aa21\") " Jul 06 18:22:17.698072 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.698039 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abd4e443-802d-4fbb-afd4-89cd30d9aa21" (UID: "abd4e443-802d-4fbb-afd4-89cd30d9aa21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:22:17.699638 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.699615 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abd4e443-802d-4fbb-afd4-89cd30d9aa21" (UID: "abd4e443-802d-4fbb-afd4-89cd30d9aa21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:22:17.699749 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.699729 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std" (OuterVolumeSpecName: "kube-api-access-l4std") pod "abd4e443-802d-4fbb-afd4-89cd30d9aa21" (UID: "abd4e443-802d-4fbb-afd4-89cd30d9aa21"). InnerVolumeSpecName "kube-api-access-l4std". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:22:17.798535 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.798448 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4std\" (UniqueName: \"kubernetes.io/projected/abd4e443-802d-4fbb-afd4-89cd30d9aa21-kube-api-access-l4std\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.798535 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.798478 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abd4e443-802d-4fbb-afd4-89cd30d9aa21-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.798535 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.798493 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abd4e443-802d-4fbb-afd4-89cd30d9aa21-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:22:17.928014 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.927981 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:22:17.932966 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:17.932938 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-12711072-68cf78d85d-n66fv"] Jul 06 18:22:19.035649 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:22:19.035615 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" path="/var/lib/kubelet/pods/abd4e443-802d-4fbb-afd4-89cd30d9aa21/volumes" Jul 06 18:24:10.777934 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.777900 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:24:10.778546 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.778351 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerName="maas-api" Jul 06 18:24:10.778546 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.778370 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerName="maas-api" Jul 06 18:24:10.778546 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.778493 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd4e443-802d-4fbb-afd4-89cd30d9aa21" containerName="maas-api" Jul 06 18:24:10.781693 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.781674 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.789939 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.789917 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-a9cadd-serving-cert\"" Jul 06 18:24:10.801843 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.801819 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:24:10.829404 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.829372 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdlbx\" (UniqueName: \"kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.829588 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.829439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.829588 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.829534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.930912 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.930878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdlbx\" (UniqueName: \"kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.931109 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.930932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.931109 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.930986 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.931232 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:24:10.931112 2555 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-a9cadd-serving-cert: secret "maas-api-e2e-inf-a-a9cadd-serving-cert" not found Jul 06 18:24:10.931232 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:24:10.931197 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls podName:c51bd6de-91ed-42c7-96aa-dc2d1d94bc85 nodeName:}" failed. No retries permitted until 2026-07-06 18:24:11.431172403 +0000 UTC m=+1944.919699488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls") pod "maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" (UID: "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85") : secret "maas-api-e2e-inf-a-a9cadd-serving-cert" not found Jul 06 18:24:10.931879 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.931853 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:10.941217 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:10.941199 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdlbx\" (UniqueName: \"kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:11.435406 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:11.435369 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:11.437792 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:11.437771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") pod \"maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:11.692146 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:11.692062 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:11.832042 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:11.832016 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:24:11.834413 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:24:11.834383 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51bd6de_91ed_42c7_96aa_dc2d1d94bc85.slice/crio-f9db57a757c1304f4cfd22e2d29dc8042e69d653afc259ff668463f6bb80fa48 WatchSource:0}: Error finding container f9db57a757c1304f4cfd22e2d29dc8042e69d653afc259ff668463f6bb80fa48: Status 404 returned error can't find the container with id f9db57a757c1304f4cfd22e2d29dc8042e69d653afc259ff668463f6bb80fa48 Jul 06 18:24:11.835916 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:11.835895 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:24:12.137486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:12.137451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" event={"ID":"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85","Type":"ContainerStarted","Data":"f9db57a757c1304f4cfd22e2d29dc8042e69d653afc259ff668463f6bb80fa48"} Jul 06 18:24:13.143957 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:13.143924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" event={"ID":"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85","Type":"ContainerStarted","Data":"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296"} Jul 06 18:24:13.144365 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:13.144021 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:13.166086 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:13.166032 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" podStartSLOduration=2.74205371 podStartE2EDuration="3.16601426s" totalImagesPullingTime="423.96055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:13.164623487 +0000 UTC m=+1946.653150594" watchObservedRunningTime="2026-07-06 18:24:13.16601426 +0000 UTC m=+1946.654541398" Jul 06 18:24:18.645682 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.645650 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:24:18.649689 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.649667 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.652333 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.652308 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-cd9691-serving-cert\"" Jul 06 18:24:18.660265 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.660201 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:24:18.701870 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.701836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.701991 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.701881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck892\" (UniqueName: \"kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.701991 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.701951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.803023 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.802995 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.803210 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.803086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.803210 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.803103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck892\" (UniqueName: \"kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.803748 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.803723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.805527 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.805502 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.827796 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.827769 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck892\" (UniqueName: \"kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892\") pod \"maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:18.963197 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:18.963108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:19.108445 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:19.108397 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:24:19.110402 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:24:19.110377 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762f45ca_b5ea_41ba_8c73_bdf9660dd488.slice/crio-a9ca0117a0732570a1316b6b7c8e35fe6bcaec178d57a6b9ca7a506e4be363bc WatchSource:0}: Error finding container a9ca0117a0732570a1316b6b7c8e35fe6bcaec178d57a6b9ca7a506e4be363bc: Status 404 returned error can't find the container with id a9ca0117a0732570a1316b6b7c8e35fe6bcaec178d57a6b9ca7a506e4be363bc Jul 06 18:24:19.154552 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:19.154530 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:24:19.173078 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:19.173054 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" event={"ID":"762f45ca-b5ea-41ba-8c73-bdf9660dd488","Type":"ContainerStarted","Data":"a9ca0117a0732570a1316b6b7c8e35fe6bcaec178d57a6b9ca7a506e4be363bc"} Jul 06 18:24:20.186625 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:20.186577 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" event={"ID":"762f45ca-b5ea-41ba-8c73-bdf9660dd488","Type":"ContainerStarted","Data":"29ba9c16cbefb9b7b94e18c61616c9c5d9faaf16bc19f9e6cb414f53d97c38a1"} Jul 06 18:24:20.187080 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:20.186731 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:24:20.206860 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:20.206813 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" podStartSLOduration=1.875770863 podStartE2EDuration="2.206798123s" totalImagesPullingTime="331.02726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:20.204803924 +0000 UTC m=+1953.693331056" watchObservedRunningTime="2026-07-06 18:24:20.206798123 +0000 UTC m=+1953.695325227" Jul 06 18:24:26.197827 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:24:26.197803 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:25:18.412881 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.412838 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:25:18.413440 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.413124 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" podUID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" containerName="maas-api" containerID="cri-o://5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296" gracePeriod=30 Jul 06 18:25:18.659782 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.659758 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:25:18.676401 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.676333 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca\") pod \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " Jul 06 18:25:18.676557 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.676403 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdlbx\" (UniqueName: \"kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx\") pod \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " Jul 06 18:25:18.676557 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.676451 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") pod \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\" (UID: \"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85\") " Jul 06 18:25:18.676775 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.676745 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" (UID: "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:25:18.678663 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.678600 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx" (OuterVolumeSpecName: "kube-api-access-sdlbx") pod "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" (UID: "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85"). InnerVolumeSpecName "kube-api-access-sdlbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:25:18.679225 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.679189 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" (UID: "c51bd6de-91ed-42c7-96aa-dc2d1d94bc85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:25:18.777056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.777024 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:25:18.777056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.777050 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdlbx\" (UniqueName: \"kubernetes.io/projected/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-kube-api-access-sdlbx\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:25:18.777056 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:18.777059 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:25:19.473462 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.473354 2555 generic.go:356] "Generic (PLEG): container finished" podID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" containerID="5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296" exitCode=0 Jul 06 18:25:19.473462 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.473402 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" Jul 06 18:25:19.473462 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.473401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" event={"ID":"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85","Type":"ContainerDied","Data":"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296"} Jul 06 18:25:19.474039 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.473509 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5" event={"ID":"c51bd6de-91ed-42c7-96aa-dc2d1d94bc85","Type":"ContainerDied","Data":"f9db57a757c1304f4cfd22e2d29dc8042e69d653afc259ff668463f6bb80fa48"} Jul 06 18:25:19.474039 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.473548 2555 scope.go:117] "RemoveContainer" containerID="5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296" Jul 06 18:25:19.482222 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.482208 2555 scope.go:117] "RemoveContainer" containerID="5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296" Jul 06 18:25:19.482489 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:25:19.482456 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296\": container with ID starting with 5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296 not found: ID does not exist" containerID="5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296" Jul 06 18:25:19.482590 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.482492 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296"} err="failed to get container status \"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296\": rpc error: code = NotFound desc = could not find container \"5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296\": container with ID starting with 5f8ca25a6e3721f1bed8e7a2a2158b67d6ae9d8d2d63023abc268251064bc296 not found: ID does not exist" Jul 06 18:25:19.491592 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.491570 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:25:19.495719 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:19.495699 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-a9cadd-6779b6c4f5-crgj5"] Jul 06 18:25:21.034364 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:25:21.034329 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" path="/var/lib/kubelet/pods/c51bd6de-91ed-42c7-96aa-dc2d1d94bc85/volumes" Jul 06 18:26:02.474988 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.474943 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:26:02.475554 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.475185 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" podUID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" containerName="maas-api" containerID="cri-o://29ba9c16cbefb9b7b94e18c61616c9c5d9faaf16bc19f9e6cb414f53d97c38a1" gracePeriod=30 Jul 06 18:26:02.680488 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.680457 2555 generic.go:356] "Generic (PLEG): container finished" podID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" containerID="29ba9c16cbefb9b7b94e18c61616c9c5d9faaf16bc19f9e6cb414f53d97c38a1" exitCode=0 Jul 06 18:26:02.680651 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.680514 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" event={"ID":"762f45ca-b5ea-41ba-8c73-bdf9660dd488","Type":"ContainerDied","Data":"29ba9c16cbefb9b7b94e18c61616c9c5d9faaf16bc19f9e6cb414f53d97c38a1"} Jul 06 18:26:02.728236 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.728173 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:26:02.783286 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.783255 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca\") pod \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " Jul 06 18:26:02.783486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.783345 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck892\" (UniqueName: \"kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892\") pod \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " Jul 06 18:26:02.783486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.783382 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls\") pod \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\" (UID: \"762f45ca-b5ea-41ba-8c73-bdf9660dd488\") " Jul 06 18:26:02.783718 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.783688 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "762f45ca-b5ea-41ba-8c73-bdf9660dd488" (UID: "762f45ca-b5ea-41ba-8c73-bdf9660dd488"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:02.785448 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.785396 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892" (OuterVolumeSpecName: "kube-api-access-ck892") pod "762f45ca-b5ea-41ba-8c73-bdf9660dd488" (UID: "762f45ca-b5ea-41ba-8c73-bdf9660dd488"). InnerVolumeSpecName "kube-api-access-ck892". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:02.785571 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.785504 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "762f45ca-b5ea-41ba-8c73-bdf9660dd488" (UID: "762f45ca-b5ea-41ba-8c73-bdf9660dd488"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:26:02.884380 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.884344 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/762f45ca-b5ea-41ba-8c73-bdf9660dd488-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:02.884380 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.884372 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/762f45ca-b5ea-41ba-8c73-bdf9660dd488-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:02.884380 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:02.884384 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck892\" (UniqueName: \"kubernetes.io/projected/762f45ca-b5ea-41ba-8c73-bdf9660dd488-kube-api-access-ck892\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:03.686510 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:03.686477 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" Jul 06 18:26:03.686510 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:03.686495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc" event={"ID":"762f45ca-b5ea-41ba-8c73-bdf9660dd488","Type":"ContainerDied","Data":"a9ca0117a0732570a1316b6b7c8e35fe6bcaec178d57a6b9ca7a506e4be363bc"} Jul 06 18:26:03.687138 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:03.686568 2555 scope.go:117] "RemoveContainer" containerID="29ba9c16cbefb9b7b94e18c61616c9c5d9faaf16bc19f9e6cb414f53d97c38a1" Jul 06 18:26:03.705105 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:03.705078 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:26:03.714071 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:03.714033 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cd9691-ffc5768bb-btbhc"] Jul 06 18:26:05.034773 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:05.034728 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" path="/var/lib/kubelet/pods/762f45ca-b5ea-41ba-8c73-bdf9660dd488/volumes" Jul 06 18:26:12.452012 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.451926 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:12.452543 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452525 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" containerName="maas-api" Jul 06 18:26:12.452602 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452547 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" containerName="maas-api" Jul 06 18:26:12.452602 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452575 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" containerName="maas-api" Jul 06 18:26:12.452602 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452585 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" containerName="maas-api" Jul 06 18:26:12.452707 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452678 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51bd6de-91ed-42c7-96aa-dc2d1d94bc85" containerName="maas-api" Jul 06 18:26:12.452707 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.452691 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="762f45ca-b5ea-41ba-8c73-bdf9660dd488" containerName="maas-api" Jul 06 18:26:12.459010 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.458986 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.462836 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.462808 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-1ee192-serving-cert\"" Jul 06 18:26:12.485919 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.485893 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:12.570571 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.570537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.570782 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.570598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.570782 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.570701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtvw\" (UniqueName: \"kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.672093 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.672054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.672294 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.672118 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtvw\" (UniqueName: \"kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.672294 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.672209 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.672887 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.672858 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.674519 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.674498 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.697569 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.697532 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtvw\" (UniqueName: \"kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw\") pod \"maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.770751 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.770715 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:12.931886 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:12.931862 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:12.933653 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:26:12.933629 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9d23b1_893c_4763_bd40_fbeda6fa051d.slice/crio-d808f4ad907d417627846bdbfaaf0216dee7b7827f161f36bdb18f09188f558b WatchSource:0}: Error finding container d808f4ad907d417627846bdbfaaf0216dee7b7827f161f36bdb18f09188f558b: Status 404 returned error can't find the container with id d808f4ad907d417627846bdbfaaf0216dee7b7827f161f36bdb18f09188f558b Jul 06 18:26:13.734269 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:13.734178 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" event={"ID":"de9d23b1-893c-4763-bd40-fbeda6fa051d","Type":"ContainerStarted","Data":"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d"} Jul 06 18:26:13.734269 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:13.734258 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" event={"ID":"de9d23b1-893c-4763-bd40-fbeda6fa051d","Type":"ContainerStarted","Data":"d808f4ad907d417627846bdbfaaf0216dee7b7827f161f36bdb18f09188f558b"} Jul 06 18:26:13.734739 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:13.734305 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:13.784897 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:13.784847 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" podStartSLOduration=1.38227733 podStartE2EDuration="1.784831674s" totalImagesPullingTime="402.554344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:13.783497803 +0000 UTC m=+2067.272024906" watchObservedRunningTime="2026-07-06 18:26:13.784831674 +0000 UTC m=+2067.273358778" Jul 06 18:26:19.744401 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:19.744370 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:20.439567 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.439525 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:20.444122 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.444098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.446843 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.446807 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-30a7ce-serving-cert\"" Jul 06 18:26:20.456390 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.456360 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:20.547107 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.547065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.547275 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.547147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.547275 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.547184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmvb\" (UniqueName: \"kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.648253 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.648216 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.648473 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.648279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.648473 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.648313 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmvb\" (UniqueName: \"kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.648991 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.648964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.650742 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.650718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.657087 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.657066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmvb\" (UniqueName: \"kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb\") pod \"maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:20.758453 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:20.758391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:21.113258 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:21.113233 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:21.115591 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:26:21.115558 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fd37e4_5ef4_4541_beb8_2363875d2d12.slice/crio-cd2dddd31ec904f7fa540ec122f9b2764052e01ea79c21070e73b99b44c7bd51 WatchSource:0}: Error finding container cd2dddd31ec904f7fa540ec122f9b2764052e01ea79c21070e73b99b44c7bd51: Status 404 returned error can't find the container with id cd2dddd31ec904f7fa540ec122f9b2764052e01ea79c21070e73b99b44c7bd51 Jul 06 18:26:21.787155 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:21.787120 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" event={"ID":"34fd37e4-5ef4-4541-beb8-2363875d2d12","Type":"ContainerStarted","Data":"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f"} Jul 06 18:26:21.787572 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:21.787175 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" event={"ID":"34fd37e4-5ef4-4541-beb8-2363875d2d12","Type":"ContainerStarted","Data":"cd2dddd31ec904f7fa540ec122f9b2764052e01ea79c21070e73b99b44c7bd51"} Jul 06 18:26:21.787572 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:21.787209 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:21.808619 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:21.808550 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" podStartSLOduration=1.488650902 podStartE2EDuration="1.808533278s" totalImagesPullingTime="319.882376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:21.807976907 +0000 UTC m=+2075.296504013" watchObservedRunningTime="2026-07-06 18:26:21.808533278 +0000 UTC m=+2075.297060382" Jul 06 18:26:27.797968 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:27.797942 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:33.477913 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.477881 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:33.478379 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.478097 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" podUID="de9d23b1-893c-4763-bd40-fbeda6fa051d" containerName="maas-api" containerID="cri-o://9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d" gracePeriod=30 Jul 06 18:26:33.725353 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.725322 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:33.847283 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.847248 2555 generic.go:356] "Generic (PLEG): container finished" podID="de9d23b1-893c-4763-bd40-fbeda6fa051d" containerID="9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d" exitCode=0 Jul 06 18:26:33.847538 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.847295 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" Jul 06 18:26:33.847538 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.847316 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" event={"ID":"de9d23b1-893c-4763-bd40-fbeda6fa051d","Type":"ContainerDied","Data":"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d"} Jul 06 18:26:33.847538 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.847369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9" event={"ID":"de9d23b1-893c-4763-bd40-fbeda6fa051d","Type":"ContainerDied","Data":"d808f4ad907d417627846bdbfaaf0216dee7b7827f161f36bdb18f09188f558b"} Jul 06 18:26:33.847538 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.847398 2555 scope.go:117] "RemoveContainer" containerID="9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d" Jul 06 18:26:33.855975 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.855955 2555 scope.go:117] "RemoveContainer" containerID="9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d" Jul 06 18:26:33.856234 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:33.856214 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d\": container with ID starting with 9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d not found: ID does not exist" containerID="9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d" Jul 06 18:26:33.856282 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.856245 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d"} err="failed to get container status \"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d\": rpc error: code = NotFound desc = could not find container \"9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d\": container with ID starting with 9bcb6d54dca60c5469ad819b197f243abf213896178bab1bf876662c1c3ff22d not found: ID does not exist" Jul 06 18:26:33.883703 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.883683 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls\") pod \"de9d23b1-893c-4763-bd40-fbeda6fa051d\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " Jul 06 18:26:33.883811 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.883774 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qtvw\" (UniqueName: \"kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw\") pod \"de9d23b1-893c-4763-bd40-fbeda6fa051d\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " Jul 06 18:26:33.883811 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.883803 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca\") pod \"de9d23b1-893c-4763-bd40-fbeda6fa051d\" (UID: \"de9d23b1-893c-4763-bd40-fbeda6fa051d\") " Jul 06 18:26:33.884186 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.884162 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de9d23b1-893c-4763-bd40-fbeda6fa051d" (UID: "de9d23b1-893c-4763-bd40-fbeda6fa051d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:33.885723 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.885700 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de9d23b1-893c-4763-bd40-fbeda6fa051d" (UID: "de9d23b1-893c-4763-bd40-fbeda6fa051d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:26:33.885802 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.885788 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw" (OuterVolumeSpecName: "kube-api-access-5qtvw") pod "de9d23b1-893c-4763-bd40-fbeda6fa051d" (UID: "de9d23b1-893c-4763-bd40-fbeda6fa051d"). InnerVolumeSpecName "kube-api-access-5qtvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:33.984837 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.984801 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qtvw\" (UniqueName: \"kubernetes.io/projected/de9d23b1-893c-4763-bd40-fbeda6fa051d-kube-api-access-5qtvw\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:33.984837 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.984832 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de9d23b1-893c-4763-bd40-fbeda6fa051d-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:33.984837 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:33.984842 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de9d23b1-893c-4763-bd40-fbeda6fa051d-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:34.187699 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:34.187667 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:34.190300 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:34.190275 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1ee192-56cb4549b7-kcmn9"] Jul 06 18:26:35.036054 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:35.036014 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de9d23b1-893c-4763-bd40-fbeda6fa051d" path="/var/lib/kubelet/pods/de9d23b1-893c-4763-bd40-fbeda6fa051d/volumes" Jul 06 18:26:40.850463 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:40.850414 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:40.850920 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:40.850645 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" podUID="34fd37e4-5ef4-4541-beb8-2363875d2d12" containerName="maas-api" containerID="cri-o://170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f" gracePeriod=30 Jul 06 18:26:41.102715 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.102656 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:41.142896 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.142864 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls\") pod \"34fd37e4-5ef4-4541-beb8-2363875d2d12\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " Jul 06 18:26:41.143079 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.142939 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca\") pod \"34fd37e4-5ef4-4541-beb8-2363875d2d12\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " Jul 06 18:26:41.143079 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.142983 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvmvb\" (UniqueName: \"kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb\") pod \"34fd37e4-5ef4-4541-beb8-2363875d2d12\" (UID: \"34fd37e4-5ef4-4541-beb8-2363875d2d12\") " Jul 06 18:26:41.143418 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.143384 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34fd37e4-5ef4-4541-beb8-2363875d2d12" (UID: "34fd37e4-5ef4-4541-beb8-2363875d2d12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:41.145174 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.145143 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34fd37e4-5ef4-4541-beb8-2363875d2d12" (UID: "34fd37e4-5ef4-4541-beb8-2363875d2d12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:26:41.145291 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.145200 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb" (OuterVolumeSpecName: "kube-api-access-fvmvb") pod "34fd37e4-5ef4-4541-beb8-2363875d2d12" (UID: "34fd37e4-5ef4-4541-beb8-2363875d2d12"). InnerVolumeSpecName "kube-api-access-fvmvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:41.244490 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.244451 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd37e4-5ef4-4541-beb8-2363875d2d12-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:41.244490 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.244483 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd37e4-5ef4-4541-beb8-2363875d2d12-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:41.244490 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.244494 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvmvb\" (UniqueName: \"kubernetes.io/projected/34fd37e4-5ef4-4541-beb8-2363875d2d12-kube-api-access-fvmvb\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:26:41.889412 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.889374 2555 generic.go:356] "Generic (PLEG): container finished" podID="34fd37e4-5ef4-4541-beb8-2363875d2d12" containerID="170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f" exitCode=0 Jul 06 18:26:41.889867 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.889448 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" Jul 06 18:26:41.889867 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.889462 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" event={"ID":"34fd37e4-5ef4-4541-beb8-2363875d2d12","Type":"ContainerDied","Data":"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f"} Jul 06 18:26:41.889867 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.889520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f" event={"ID":"34fd37e4-5ef4-4541-beb8-2363875d2d12","Type":"ContainerDied","Data":"cd2dddd31ec904f7fa540ec122f9b2764052e01ea79c21070e73b99b44c7bd51"} Jul 06 18:26:41.889867 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.889541 2555 scope.go:117] "RemoveContainer" containerID="170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f" Jul 06 18:26:41.898631 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.898611 2555 scope.go:117] "RemoveContainer" containerID="170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f" Jul 06 18:26:41.898905 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:41.898887 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f\": container with ID starting with 170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f not found: ID does not exist" containerID="170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f" Jul 06 18:26:41.898973 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.898913 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f"} err="failed to get container status \"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f\": rpc error: code = NotFound desc = could not find container \"170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f\": container with ID starting with 170ce3a50da5fe85ef06452586799a9b4852daa2fac27194d2678053eb7aaf5f not found: ID does not exist" Jul 06 18:26:41.912449 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.912411 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:41.917185 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:41.917162 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-30a7ce-5f489566cd-fn79f"] Jul 06 18:26:43.034752 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:43.034717 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34fd37e4-5ef4-4541-beb8-2363875d2d12" path="/var/lib/kubelet/pods/34fd37e4-5ef4-4541-beb8-2363875d2d12/volumes" Jul 06 18:26:51.444263 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.444228 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:26:51.445108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.444948 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fd37e4-5ef4-4541-beb8-2363875d2d12" containerName="maas-api" Jul 06 18:26:51.445108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.444974 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fd37e4-5ef4-4541-beb8-2363875d2d12" containerName="maas-api" Jul 06 18:26:51.445108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.445039 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de9d23b1-893c-4763-bd40-fbeda6fa051d" containerName="maas-api" Jul 06 18:26:51.445108 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.445050 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="de9d23b1-893c-4763-bd40-fbeda6fa051d" containerName="maas-api" Jul 06 18:26:51.445460 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.445151 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="34fd37e4-5ef4-4541-beb8-2363875d2d12" containerName="maas-api" Jul 06 18:26:51.445460 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.445168 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="de9d23b1-893c-4763-bd40-fbeda6fa051d" containerName="maas-api" Jul 06 18:26:51.448595 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.448571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.452019 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.451998 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9c9be0-serving-cert\"" Jul 06 18:26:51.461570 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.461543 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:26:51.532057 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.532015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2228\" (UniqueName: \"kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.532057 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.532057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.532277 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.532193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.633417 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.633372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.633623 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.633511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2228\" (UniqueName: \"kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.633623 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.633546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.633623 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:51.633565 2555 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-9c9be0-serving-cert: secret "maas-api-e2e-shared-a-9c9be0-serving-cert" not found Jul 06 18:26:51.633733 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:51.633663 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls podName:655aa0e4-a4ea-433a-ae6a-00ad797bc7be nodeName:}" failed. No retries permitted until 2026-07-06 18:26:52.133641842 +0000 UTC m=+2105.622168940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls") pod "maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" (UID: "655aa0e4-a4ea-433a-ae6a-00ad797bc7be") : secret "maas-api-e2e-shared-a-9c9be0-serving-cert" not found Jul 06 18:26:51.634232 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.634210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:51.649563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:51.649524 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2228\" (UniqueName: \"kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:52.138797 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.138754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:52.141262 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.141237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:52.363549 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.363514 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:52.511400 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.511375 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:26:52.512885 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:26:52.512854 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655aa0e4_a4ea_433a_ae6a_00ad797bc7be.slice/crio-4dc5685d97b0069c01c81887a008883440196e16faf6cb7258e334e9087fc846 WatchSource:0}: Error finding container 4dc5685d97b0069c01c81887a008883440196e16faf6cb7258e334e9087fc846: Status 404 returned error can't find the container with id 4dc5685d97b0069c01c81887a008883440196e16faf6cb7258e334e9087fc846 Jul 06 18:26:52.945592 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.945549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" event={"ID":"655aa0e4-a4ea-433a-ae6a-00ad797bc7be","Type":"ContainerStarted","Data":"f97172d051ada0a204da3762472884dbd3f52994d151206728206fc8f91fb9f0"} Jul 06 18:26:52.945799 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.945616 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" event={"ID":"655aa0e4-a4ea-433a-ae6a-00ad797bc7be","Type":"ContainerStarted","Data":"4dc5685d97b0069c01c81887a008883440196e16faf6cb7258e334e9087fc846"} Jul 06 18:26:52.945799 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.945653 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:52.966129 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:52.966066 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" podStartSLOduration=1.6252620009999998 podStartE2EDuration="1.966048983s" totalImagesPullingTime="340.786982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:52.964652223 +0000 UTC m=+2106.453179319" watchObservedRunningTime="2026-07-06 18:26:52.966048983 +0000 UTC m=+2106.454576086" Jul 06 18:26:58.956437 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:58.956394 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:26:59.450485 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.450453 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:26:59.454525 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.454502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.457140 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.457118 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-b6a5ee-serving-cert\"" Jul 06 18:26:59.469860 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.469826 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:26:59.506242 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.506210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgp4k\" (UniqueName: \"kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.506448 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.506245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.506448 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.506264 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.607465 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.607414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgp4k\" (UniqueName: \"kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.607630 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.607480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.607630 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.607508 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.607712 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:59.607645 2555 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-b6a5ee-serving-cert: secret "maas-api-e2e-shared-b-b6a5ee-serving-cert" not found Jul 06 18:26:59.607751 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:26:59.607730 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls podName:3b18b889-733c-422a-8302-02860bef2ad1 nodeName:}" failed. No retries permitted until 2026-07-06 18:27:00.107710264 +0000 UTC m=+2113.596237354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls") pod "maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" (UID: "3b18b889-733c-422a-8302-02860bef2ad1") : secret "maas-api-e2e-shared-b-b6a5ee-serving-cert" not found Jul 06 18:26:59.608238 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.608218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:26:59.620271 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:26:59.620234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgp4k\" (UniqueName: \"kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:27:00.113000 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.112964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:27:00.115505 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.115472 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") pod \"maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:27:00.365665 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.365571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:27:00.510912 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.510880 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:27:00.512563 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:27:00.512538 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b18b889_733c_422a_8302_02860bef2ad1.slice/crio-a70a0b526dbf8e52b1aeea07133f2c70d5d29c03bb1c73def3961a33baead72e WatchSource:0}: Error finding container a70a0b526dbf8e52b1aeea07133f2c70d5d29c03bb1c73def3961a33baead72e: Status 404 returned error can't find the container with id a70a0b526dbf8e52b1aeea07133f2c70d5d29c03bb1c73def3961a33baead72e Jul 06 18:27:00.984991 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.984958 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" event={"ID":"3b18b889-733c-422a-8302-02860bef2ad1","Type":"ContainerStarted","Data":"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0"} Jul 06 18:27:00.985152 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.985011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" event={"ID":"3b18b889-733c-422a-8302-02860bef2ad1","Type":"ContainerStarted","Data":"a70a0b526dbf8e52b1aeea07133f2c70d5d29c03bb1c73def3961a33baead72e"} Jul 06 18:27:00.985152 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:00.985063 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:27:01.005211 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:01.005155 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" podStartSLOduration=1.672790935 podStartE2EDuration="2.005141031s" totalImagesPullingTime="332.350096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:27:01.003831016 +0000 UTC m=+2114.492358121" watchObservedRunningTime="2026-07-06 18:27:01.005141031 +0000 UTC m=+2114.493668134" Jul 06 18:27:06.995278 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:27:06.995249 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:32:20.161794 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.161712 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:32:20.162625 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.161980 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" podUID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" containerName="maas-api" containerID="cri-o://f97172d051ada0a204da3762472884dbd3f52994d151206728206fc8f91fb9f0" gracePeriod=30 Jul 06 18:32:20.536106 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.536032 2555 generic.go:356] "Generic (PLEG): container finished" podID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" containerID="f97172d051ada0a204da3762472884dbd3f52994d151206728206fc8f91fb9f0" exitCode=0 Jul 06 18:32:20.536248 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.536102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" event={"ID":"655aa0e4-a4ea-433a-ae6a-00ad797bc7be","Type":"ContainerDied","Data":"f97172d051ada0a204da3762472884dbd3f52994d151206728206fc8f91fb9f0"} Jul 06 18:32:20.613613 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.613587 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:32:20.751103 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.751075 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca\") pod \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " Jul 06 18:32:20.751261 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.751146 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") pod \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " Jul 06 18:32:20.751261 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.751222 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2228\" (UniqueName: \"kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228\") pod \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\" (UID: \"655aa0e4-a4ea-433a-ae6a-00ad797bc7be\") " Jul 06 18:32:20.751570 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.751540 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "655aa0e4-a4ea-433a-ae6a-00ad797bc7be" (UID: "655aa0e4-a4ea-433a-ae6a-00ad797bc7be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:32:20.753235 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.753212 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "655aa0e4-a4ea-433a-ae6a-00ad797bc7be" (UID: "655aa0e4-a4ea-433a-ae6a-00ad797bc7be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:32:20.753306 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.753241 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228" (OuterVolumeSpecName: "kube-api-access-q2228") pod "655aa0e4-a4ea-433a-ae6a-00ad797bc7be" (UID: "655aa0e4-a4ea-433a-ae6a-00ad797bc7be"). InnerVolumeSpecName "kube-api-access-q2228". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:32:20.852665 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.852632 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:32:20.852665 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.852660 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2228\" (UniqueName: \"kubernetes.io/projected/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-kube-api-access-q2228\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:32:20.852665 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:20.852670 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/655aa0e4-a4ea-433a-ae6a-00ad797bc7be-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:32:21.542157 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:21.542125 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" Jul 06 18:32:21.542157 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:21.542136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk" event={"ID":"655aa0e4-a4ea-433a-ae6a-00ad797bc7be","Type":"ContainerDied","Data":"4dc5685d97b0069c01c81887a008883440196e16faf6cb7258e334e9087fc846"} Jul 06 18:32:21.542667 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:21.542205 2555 scope.go:117] "RemoveContainer" containerID="f97172d051ada0a204da3762472884dbd3f52994d151206728206fc8f91fb9f0" Jul 06 18:32:21.557885 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:21.557851 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:32:21.561711 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:21.561675 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c9be0-768fd6f6f5-98htk"] Jul 06 18:32:23.034840 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:32:23.034807 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" path="/var/lib/kubelet/pods/655aa0e4-a4ea-433a-ae6a-00ad797bc7be/volumes" Jul 06 18:33:03.352546 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.352507 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:33:03.353054 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.352805 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" podUID="3b18b889-733c-422a-8302-02860bef2ad1" containerName="maas-api" containerID="cri-o://86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0" gracePeriod=30 Jul 06 18:33:03.594563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.594540 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:33:03.658938 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.658856 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") pod \"3b18b889-733c-422a-8302-02860bef2ad1\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " Jul 06 18:33:03.658938 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.658897 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgp4k\" (UniqueName: \"kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k\") pod \"3b18b889-733c-422a-8302-02860bef2ad1\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " Jul 06 18:33:03.659119 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.658996 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca\") pod \"3b18b889-733c-422a-8302-02860bef2ad1\" (UID: \"3b18b889-733c-422a-8302-02860bef2ad1\") " Jul 06 18:33:03.659355 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.659333 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b18b889-733c-422a-8302-02860bef2ad1" (UID: "3b18b889-733c-422a-8302-02860bef2ad1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:33:03.661064 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.661026 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b18b889-733c-422a-8302-02860bef2ad1" (UID: "3b18b889-733c-422a-8302-02860bef2ad1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:33:03.661064 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.661035 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k" (OuterVolumeSpecName: "kube-api-access-xgp4k") pod "3b18b889-733c-422a-8302-02860bef2ad1" (UID: "3b18b889-733c-422a-8302-02860bef2ad1"). InnerVolumeSpecName "kube-api-access-xgp4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:03.744303 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.744272 2555 generic.go:356] "Generic (PLEG): container finished" podID="3b18b889-733c-422a-8302-02860bef2ad1" containerID="86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0" exitCode=0 Jul 06 18:33:03.744496 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.744319 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" Jul 06 18:33:03.744496 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.744360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" event={"ID":"3b18b889-733c-422a-8302-02860bef2ad1","Type":"ContainerDied","Data":"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0"} Jul 06 18:33:03.744496 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.744416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz" event={"ID":"3b18b889-733c-422a-8302-02860bef2ad1","Type":"ContainerDied","Data":"a70a0b526dbf8e52b1aeea07133f2c70d5d29c03bb1c73def3961a33baead72e"} Jul 06 18:33:03.744496 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.744457 2555 scope.go:117] "RemoveContainer" containerID="86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0" Jul 06 18:33:03.753446 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.753402 2555 scope.go:117] "RemoveContainer" containerID="86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0" Jul 06 18:33:03.753694 ip-10-0-134-39 kubenswrapper[2555]: E0706 18:33:03.753674 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0\": container with ID starting with 86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0 not found: ID does not exist" containerID="86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0" Jul 06 18:33:03.753748 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.753701 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0"} err="failed to get container status \"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0\": rpc error: code = NotFound desc = could not find container \"86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0\": container with ID starting with 86137882e4505c83d77c5ad6590aea340a6bca54513db264c200f7803c02f9e0 not found: ID does not exist" Jul 06 18:33:03.759741 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.759723 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b18b889-733c-422a-8302-02860bef2ad1-openshift-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:33:03.759806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.759743 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b18b889-733c-422a-8302-02860bef2ad1-maas-api-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:33:03.759806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.759752 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgp4k\" (UniqueName: \"kubernetes.io/projected/3b18b889-733c-422a-8302-02860bef2ad1-kube-api-access-xgp4k\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 18:33:03.765385 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.765364 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:33:03.769801 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:03.769778 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-b6a5ee-666667584d-xbpwz"] Jul 06 18:33:05.034656 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:05.034620 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b18b889-733c-422a-8302-02860bef2ad1" path="/var/lib/kubelet/pods/3b18b889-733c-422a-8302-02860bef2ad1/volumes" Jul 06 18:33:15.729229 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:15.729186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67d7cfbf95-tvlm2_0202108e-5c7f-40df-a77d-79c65976c53b/maas-api/0.log" Jul 06 18:33:16.064480 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:16.064451 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56d4ff89f9-6mgdb_03a3b048-51db-4529-b918-6ce170a7e65b/manager/0.log" Jul 06 18:33:16.520963 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:16.520934 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-9bh52_f04addbe-a657-467f-9c34-15539a6b323d/copy-manifests/0.log" Jul 06 18:33:16.528618 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:16.528595 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-9bh52_f04addbe-a657-467f-9c34-15539a6b323d/manager/0.log" Jul 06 18:33:16.777288 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:16.777202 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ccmgl_f0a8d39b-83d8-4c4e-a30d-4a18ceea5460/postgres/0.log" Jul 06 18:33:19.327005 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:19.326967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w6jjx_1f45bf00-daed-497c-9015-dfc1efa9bba8/discovery/0.log" Jul 06 18:33:19.788586 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:19.788551 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8pf28_fb3fba72-621c-4fe8-bd52-08c9ec359619/payload-pre-processing/0.log" Jul 06 18:33:19.904050 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:19.904018 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-g6x5w_215d11ad-2eda-49ea-964a-292e6e98e47f/payload-processing/0.log" Jul 06 18:33:20.380468 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:20.380443 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-shz96_155bfb20-960e-4bfe-8d1c-cd044b7b899e/main/0.log" Jul 06 18:33:20.827311 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:20.827271 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6cwc7_245820c3-27d1-4acf-b146-e330dca6b60d/main/0.log" Jul 06 18:33:27.997587 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:27.997554 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zfv8j_87b08b35-7081-421c-9bca-38c58e5e99e8/global-pull-secret-syncer/0.log" Jul 06 18:33:28.088325 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:28.088293 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jhl48_b364dff5-c989-4ff0-842f-b8b2120b3b5e/konnectivity-agent/0.log" Jul 06 18:33:28.185855 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:28.185826 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-39.ec2.internal_487ce3ac867cb6a29534fc53f0fccb26/haproxy/0.log" Jul 06 18:33:35.758399 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.758365 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-l9lcj_6a684cf9-de28-4f55-b6fd-bf14e2888558/cluster-monitoring-operator/0.log" Jul 06 18:33:35.784121 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.784096 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-phjm7_60e4df9b-f276-4411-a9db-11125be67b30/kube-state-metrics/0.log" Jul 06 18:33:35.809750 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.809721 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-phjm7_60e4df9b-f276-4411-a9db-11125be67b30/kube-rbac-proxy-main/0.log" Jul 06 18:33:35.832563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.832539 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-phjm7_60e4df9b-f276-4411-a9db-11125be67b30/kube-rbac-proxy-self/0.log" Jul 06 18:33:35.866070 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.866049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-658799bb8d-zd9k8_ee9083c8-72dd-4f5f-89d6-2bb4f3d5f7a0/metrics-server/0.log" Jul 06 18:33:35.999165 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:35.999139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-748qg_a4121f88-9661-4850-a5b8-ddec360adfdb/node-exporter/0.log" Jul 06 18:33:36.019301 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.019234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-748qg_a4121f88-9661-4850-a5b8-ddec360adfdb/kube-rbac-proxy/0.log" Jul 06 18:33:36.039782 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.039758 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-748qg_a4121f88-9661-4850-a5b8-ddec360adfdb/init-textfile/0.log" Jul 06 18:33:36.144846 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.144820 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2rgqx_7b96e0c9-79d1-457c-ad02-a8c9eb1b5903/kube-rbac-proxy-main/0.log" Jul 06 18:33:36.166605 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.166578 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2rgqx_7b96e0c9-79d1-457c-ad02-a8c9eb1b5903/kube-rbac-proxy-self/0.log" Jul 06 18:33:36.186884 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.186863 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2rgqx_7b96e0c9-79d1-457c-ad02-a8c9eb1b5903/openshift-state-metrics/0.log" Jul 06 18:33:36.226577 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.226554 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/prometheus/0.log" Jul 06 18:33:36.250193 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.250171 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/config-reloader/0.log" Jul 06 18:33:36.275199 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.275137 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/thanos-sidecar/0.log" Jul 06 18:33:36.295651 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.295632 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/kube-rbac-proxy-web/0.log" Jul 06 18:33:36.316580 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.316559 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/kube-rbac-proxy/0.log" Jul 06 18:33:36.337972 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.337950 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/kube-rbac-proxy-thanos/0.log" Jul 06 18:33:36.360141 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.360121 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24683bc9-aff6-4665-871b-32159ef4a15a/init-config-reloader/0.log" Jul 06 18:33:36.438041 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.438015 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-64dvt_cd76f6f3-d506-404c-ad36-ac27d2371eeb/prometheus-operator-admission-webhook/0.log" Jul 06 18:33:36.467026 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.466998 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854b8bcbd6-vczr2_45e90218-1f03-4471-b0c4-fdf8f6b3712c/telemeter-client/0.log" Jul 06 18:33:36.486335 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.486308 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854b8bcbd6-vczr2_45e90218-1f03-4471-b0c4-fdf8f6b3712c/reload/0.log" Jul 06 18:33:36.506760 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:36.506743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854b8bcbd6-vczr2_45e90218-1f03-4471-b0c4-fdf8f6b3712c/kube-rbac-proxy/0.log" Jul 06 18:33:37.903242 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903209 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n"] Jul 06 18:33:37.903653 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903639 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b18b889-733c-422a-8302-02860bef2ad1" containerName="maas-api" Jul 06 18:33:37.903653 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903655 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b18b889-733c-422a-8302-02860bef2ad1" containerName="maas-api" Jul 06 18:33:37.903806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903670 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" containerName="maas-api" Jul 06 18:33:37.903806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903677 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" containerName="maas-api" Jul 06 18:33:37.903806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903766 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="655aa0e4-a4ea-433a-ae6a-00ad797bc7be" containerName="maas-api" Jul 06 18:33:37.903806 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.903784 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b18b889-733c-422a-8302-02860bef2ad1" containerName="maas-api" Jul 06 18:33:37.907172 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.907156 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:37.909636 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.909618 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8v778\"/\"default-dockercfg-zn8ng\"" Jul 06 18:33:37.909742 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.909639 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8v778\"/\"openshift-service-ca.crt\"" Jul 06 18:33:37.910603 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.910588 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8v778\"/\"kube-root-ca.crt\"" Jul 06 18:33:37.914393 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.914244 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n"] Jul 06 18:33:37.958917 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.958882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-proc\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:37.959065 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.958946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-podres\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:37.959065 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.959046 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-lib-modules\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:37.959142 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.959085 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh27j\" (UniqueName: \"kubernetes.io/projected/da77146f-a9b0-44bc-97a4-0e41dfec8342-kube-api-access-sh27j\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:37.959142 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:37.959125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-sys\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060316 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-podres\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060520 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-lib-modules\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060520 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh27j\" (UniqueName: \"kubernetes.io/projected/da77146f-a9b0-44bc-97a4-0e41dfec8342-kube-api-access-sh27j\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060520 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-sys\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060520 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-proc\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060520 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060497 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-podres\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060734 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060521 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-sys\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060734 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060540 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-lib-modules\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.060734 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.060567 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da77146f-a9b0-44bc-97a4-0e41dfec8342-proc\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.068691 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.068674 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh27j\" (UniqueName: \"kubernetes.io/projected/da77146f-a9b0-44bc-97a4-0e41dfec8342-kube-api-access-sh27j\") pod \"perf-node-gather-daemonset-6jd5n\" (UID: \"da77146f-a9b0-44bc-97a4-0e41dfec8342\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.218153 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.218044 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.350391 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.350367 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n"] Jul 06 18:33:38.352251 ip-10-0-134-39 kubenswrapper[2555]: W0706 18:33:38.352223 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda77146f_a9b0_44bc_97a4_0e41dfec8342.slice/crio-762e15afc5245ea464f7cefba3659d45844e2920b8825feabc3948ba61745106 WatchSource:0}: Error finding container 762e15afc5245ea464f7cefba3659d45844e2920b8825feabc3948ba61745106: Status 404 returned error can't find the container with id 762e15afc5245ea464f7cefba3659d45844e2920b8825feabc3948ba61745106 Jul 06 18:33:38.908942 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.908909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" event={"ID":"da77146f-a9b0-44bc-97a4-0e41dfec8342","Type":"ContainerStarted","Data":"c461b5a8e614fd068ad3f89e0ca99f31ecb169a3e670eb6dc4474943066fa04d"} Jul 06 18:33:38.909399 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.908967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" event={"ID":"da77146f-a9b0-44bc-97a4-0e41dfec8342","Type":"ContainerStarted","Data":"762e15afc5245ea464f7cefba3659d45844e2920b8825feabc3948ba61745106"} Jul 06 18:33:38.909399 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.908995 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:38.926334 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.926284 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" podStartSLOduration=1.926267845 podStartE2EDuration="1.926267845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:33:38.924259238 +0000 UTC m=+2512.412786343" watchObservedRunningTime="2026-07-06 18:33:38.926267845 +0000 UTC m=+2512.414794948" Jul 06 18:33:38.933081 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:38.933059 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-qh72c_8e681b1e-2ee2-4674-b19c-d27f1c0152c8/download-server/0.log" Jul 06 18:33:40.571642 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:40.571616 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tpbk_dc1f1c95-c108-4e5e-b13b-6273cd0ac82e/dns/0.log" Jul 06 18:33:40.596229 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:40.596202 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tpbk_dc1f1c95-c108-4e5e-b13b-6273cd0ac82e/kube-rbac-proxy/0.log" Jul 06 18:33:40.785628 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:40.785601 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcxz5_46e7b2c8-5ccb-4f84-b60b-326b7fd52706/dns-node-resolver/0.log" Jul 06 18:33:41.343018 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:41.342982 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bbc86d56-v5pgx_9e1d24cf-3f6f-4816-ac67-7a236b369178/registry/0.log" Jul 06 18:33:41.367683 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:41.367659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btjc4_8f349735-c7e1-4da6-8fdd-f187d5414b53/node-ca/0.log" Jul 06 18:33:42.487442 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:42.487397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w6jjx_1f45bf00-daed-497c-9015-dfc1efa9bba8/discovery/0.log" Jul 06 18:33:42.625705 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:42.625670 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8pf28_fb3fba72-621c-4fe8-bd52-08c9ec359619/payload-pre-processing/0.log" Jul 06 18:33:42.672369 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:42.672337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-g6x5w_215d11ad-2eda-49ea-964a-292e6e98e47f/payload-processing/0.log" Jul 06 18:33:43.403083 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:43.403034 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jzsx2_073b3339-f45e-4835-a8a7-c57f39360b4f/serve-healthcheck-canary/0.log" Jul 06 18:33:43.969186 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:43.969161 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fntcq_cb8769a4-8722-40b6-a739-47f87f88cf3a/kube-rbac-proxy/0.log" Jul 06 18:33:43.988829 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:43.988804 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fntcq_cb8769a4-8722-40b6-a739-47f87f88cf3a/exporter/0.log" Jul 06 18:33:44.008759 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:44.008738 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fntcq_cb8769a4-8722-40b6-a739-47f87f88cf3a/extractor/0.log" Jul 06 18:33:44.924095 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:44.924070 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-6jd5n" Jul 06 18:33:46.479299 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:46.479272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67d7cfbf95-tvlm2_0202108e-5c7f-40df-a77d-79c65976c53b/maas-api/0.log" Jul 06 18:33:46.619860 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:46.619823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56d4ff89f9-6mgdb_03a3b048-51db-4529-b918-6ce170a7e65b/manager/0.log" Jul 06 18:33:46.792249 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:46.792209 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-9bh52_f04addbe-a657-467f-9c34-15539a6b323d/manager/0.log" Jul 06 18:33:46.813147 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:46.813126 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-9bh52_f04addbe-a657-467f-9c34-15539a6b323d/copy-manifests/0.log" Jul 06 18:33:46.934439 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:46.934404 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ccmgl_f0a8d39b-83d8-4c4e-a30d-4a18ceea5460/postgres/0.log" Jul 06 18:33:48.408058 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:48.408023 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-88fc8bffd-59qlx_601a1bf3-157e-4829-b346-7c678d4846c9/manager/1.log" Jul 06 18:33:48.408556 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:48.408244 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-88fc8bffd-59qlx_601a1bf3-157e-4829-b346-7c678d4846c9/manager/0.log" Jul 06 18:33:48.766011 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:48.765987 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w6jjx_1f45bf00-daed-497c-9015-dfc1efa9bba8/discovery/0.log" Jul 06 18:33:48.864486 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:48.864459 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8pf28_fb3fba72-621c-4fe8-bd52-08c9ec359619/payload-pre-processing/0.log" Jul 06 18:33:48.904384 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:48.904354 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-g6x5w_215d11ad-2eda-49ea-964a-292e6e98e47f/payload-processing/0.log" Jul 06 18:33:50.208645 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:50.208612 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w6jjx_1f45bf00-daed-497c-9015-dfc1efa9bba8/discovery/0.log" Jul 06 18:33:50.309511 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:50.309481 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8pf28_fb3fba72-621c-4fe8-bd52-08c9ec359619/payload-pre-processing/0.log" Jul 06 18:33:50.350277 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:50.350241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-g6x5w_215d11ad-2eda-49ea-964a-292e6e98e47f/payload-processing/0.log" Jul 06 18:33:53.414989 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:53.414960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j2xpk_992cc03f-93f0-49c1-8027-384842b00e23/migrator/0.log" Jul 06 18:33:53.433376 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:53.433346 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j2xpk_992cc03f-93f0-49c1-8027-384842b00e23/graceful-termination/0.log" Jul 06 18:33:53.797637 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:53.797601 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-2w2v5_668a7758-f76a-4fff-954b-9bc33ff6c8d9/kube-storage-version-migrator-operator/1.log" Jul 06 18:33:53.798563 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:53.798546 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-2w2v5_668a7758-f76a-4fff-954b-9bc33ff6c8d9/kube-storage-version-migrator-operator/0.log" Jul 06 18:33:54.946819 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:54.946791 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/kube-multus-additional-cni-plugins/0.log" Jul 06 18:33:54.967057 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:54.967033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/egress-router-binary-copy/0.log" Jul 06 18:33:54.986857 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:54.986830 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/cni-plugins/0.log" Jul 06 18:33:55.010334 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:55.010309 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/bond-cni-plugin/0.log" Jul 06 18:33:55.030188 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:55.030158 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/routeoverride-cni/0.log" Jul 06 18:33:55.049932 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:55.049911 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/whereabouts-cni-bincopy/0.log" Jul 06 18:33:55.070550 ip-10-0-134-39 kubenswrapper[2555]: I0706 18:33:55.070533 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9btgh_03e4a3a9-cd21-429c-b14a-0c54fecfae74/whereabouts-cni/0.log"