Jul 22 11:59:37.341768 ip-10-0-138-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 11:59:37.341777 ip-10-0-138-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 11:59:37.341784 ip-10-0-138-35 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 11:59:37.342000 ip-10-0-138-35 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 11:59:46.395144 ip-10-0-138-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 22 11:59:46.395158 ip-10-0-138-35 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1d91b708867f4cf1a265eb0b549d870e -- Jul 22 12:01:35.849287 ip-10-0-138-35 systemd[1]: Starting Kubernetes Kubelet... Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:01:36.278271 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.276868 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282496 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282514 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282518 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282521 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282523 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282526 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282528 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282531 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282534 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282536 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282539 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282542 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282546 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282550 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282554 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282558 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282561 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282564 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.300028 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282567 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282570 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282572 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282575 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282577 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282586 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282589 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282591 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282594 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282597 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282599 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282602 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282604 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282607 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282609 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282612 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282615 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282617 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282620 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.302277 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282622 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282625 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282628 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282630 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282633 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282635 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282638 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282641 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282644 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282647 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282650 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282652 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282655 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282658 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282661 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282663 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282666 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282668 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282671 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282674 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.303508 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282677 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282680 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282682 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282685 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282687 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282690 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282692 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282695 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282697 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282700 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282703 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282705 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282708 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282710 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282713 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282717 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282721 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282724 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282727 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.304435 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282730 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282733 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282735 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282739 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282742 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282744 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282747 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282749 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282752 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282754 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282757 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282760 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282762 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282765 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282768 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282770 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282773 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282776 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282778 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282781 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282783 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.305326 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282785 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.282789 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283491 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283498 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283501 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283504 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283507 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283509 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283512 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283515 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283517 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283520 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283523 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283526 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283528 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283532 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283534 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283537 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283540 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283543 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.306196 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283546 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283548 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283551 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283553 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283556 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283558 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283561 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283563 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283566 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283569 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283572 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283574 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283577 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283580 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283583 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283585 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283588 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283591 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283594 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283596 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.307083 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283599 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283601 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283604 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283608 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283612 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283615 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283619 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283622 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283625 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283627 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283631 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283633 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283637 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283639 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283642 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283644 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283647 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283649 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283652 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283654 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.307932 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283657 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283660 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283662 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283665 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283668 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283670 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283673 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283676 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283678 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283681 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283683 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283685 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283688 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283690 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283694 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283698 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283703 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283706 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283709 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.308884 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283711 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283714 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283716 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283719 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283723 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283726 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283730 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283733 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283735 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283738 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283740 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283743 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283746 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283749 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283751 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283754 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283756 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283759 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283762 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.309756 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283764 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283766 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.283769 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284150 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284155 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284158 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284161 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284163 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284166 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284169 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284172 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284174 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284177 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284180 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284183 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284186 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284188 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284191 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284193 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284198 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.310622 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284201 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284204 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284206 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284208 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284211 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284214 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284216 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284218 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284221 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284224 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284227 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284229 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284232 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284234 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284237 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284240 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284245 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284250 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284253 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.313869 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284256 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284258 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284261 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284265 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284268 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284271 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284274 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284276 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284279 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284281 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284283 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284286 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284290 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284294 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284297 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284299 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284302 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284304 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284306 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.314764 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284309 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284311 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284314 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284316 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284319 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284321 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284324 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284326 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284328 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284331 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284333 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284337 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284340 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284343 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284345 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284348 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284350 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284353 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284355 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284358 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.321574 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284360 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284363 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284366 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284368 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284371 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284375 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284378 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284381 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284384 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284388 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284391 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284394 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284397 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284399 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284402 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284405 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284407 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284410 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284412 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284415 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.322656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284418 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284420 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284423 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.284428 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284504 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284514 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284524 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284529 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284533 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284536 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284540 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284544 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284548 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284551 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284554 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284557 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284561 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284565 2564 flags.go:64] FLAG: --cgroup-root="" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284568 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284571 2564 flags.go:64] FLAG: --client-ca-file="" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284574 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284577 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284581 2564 flags.go:64] FLAG: --cluster-domain="" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284584 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 12:01:36.323505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284587 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284590 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284593 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284596 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284599 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284602 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284605 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284608 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284611 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284614 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284617 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284622 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284626 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284629 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284632 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284635 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284637 2564 flags.go:64] FLAG: --enable-server="true" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284640 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284645 2564 flags.go:64] FLAG: --event-burst="100" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284648 2564 flags.go:64] FLAG: --event-qps="50" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284651 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284653 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284656 2564 flags.go:64] FLAG: --eviction-hard="" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284660 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 12:01:36.324587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284663 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284667 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284670 2564 flags.go:64] FLAG: --eviction-soft="" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284672 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284675 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284679 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284681 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284684 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284687 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284690 2564 flags.go:64] FLAG: --feature-gates="" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284693 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284696 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284699 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284702 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284705 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284708 2564 flags.go:64] FLAG: --help="false" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284711 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284714 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284717 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284721 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284725 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284728 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284731 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 12:01:36.325676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284734 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284736 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284739 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284742 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284745 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284748 2564 flags.go:64] FLAG: --kube-reserved="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284751 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284753 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284756 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284759 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284763 2564 flags.go:64] FLAG: --lock-file="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284766 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284768 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284771 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284776 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284780 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284783 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284786 2564 flags.go:64] FLAG: --logging-format="text" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284789 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284792 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284794 2564 flags.go:64] FLAG: --manifest-url="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284797 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284806 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284809 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284813 2564 flags.go:64] FLAG: --max-pods="110" Jul 22 12:01:36.326755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284816 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284819 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284822 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284826 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284830 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284832 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284835 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284842 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284845 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284848 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284851 2564 flags.go:64] FLAG: --pod-cidr="" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284854 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284859 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284862 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284864 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284867 2564 flags.go:64] FLAG: --port="10250" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284870 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284875 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-023017eb4a72831bb" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284878 2564 flags.go:64] FLAG: --qos-reserved="" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284881 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284884 2564 flags.go:64] FLAG: --register-node="true" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284887 2564 flags.go:64] FLAG: --register-with-taints="" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284890 2564 flags.go:64] FLAG: --registry-burst="10" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284894 2564 flags.go:64] FLAG: --registry-qps="5" Jul 22 12:01:36.327818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284897 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284899 2564 flags.go:64] FLAG: --reserved-memory="" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284903 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284906 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284909 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284912 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284915 2564 flags.go:64] FLAG: --runonce="false" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284918 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284920 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284923 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284926 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284929 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284933 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284936 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284939 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284942 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284945 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284947 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284950 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284953 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284956 2564 flags.go:64] FLAG: --system-cgroups="" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284959 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284964 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284966 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284969 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 12:01:36.328909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284974 2564 flags.go:64] FLAG: --tls-min-version="" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284977 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284979 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284982 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284985 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284988 2564 flags.go:64] FLAG: --v="2" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284992 2564 flags.go:64] FLAG: --version="false" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284996 2564 flags.go:64] FLAG: --vmodule="" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.284999 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.285003 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285145 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285150 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285153 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285156 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285159 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285162 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285164 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285167 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285170 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285174 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285177 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.329982 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285180 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285182 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285185 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285187 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285190 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285192 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285195 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285197 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285200 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285202 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285205 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285209 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285212 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285215 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285217 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285219 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285222 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285225 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285227 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285235 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.331285 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285238 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285241 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285244 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285248 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285251 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285253 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285256 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285259 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285261 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285264 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285267 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285270 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285273 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285276 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285278 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285281 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285284 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285286 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285288 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285291 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.332354 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285293 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285296 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285298 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285302 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285306 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285310 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285313 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285315 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285318 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285321 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285324 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285326 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285332 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285335 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285338 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285340 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285344 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285347 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285350 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.333221 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285353 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285355 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285358 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285361 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285364 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285367 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285369 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285372 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285374 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285376 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285379 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285382 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285384 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285387 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285389 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285392 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285396 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285398 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285400 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285403 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.334085 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285405 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285408 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285411 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285413 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285416 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285418 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285422 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285424 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.285427 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.285435 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.291764 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.291782 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.292515 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.292526 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 12:01:36.334954 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292584 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292590 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292594 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292597 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292600 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292602 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292605 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292608 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292611 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292614 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292616 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292618 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292621 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292626 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292629 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292631 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292634 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292637 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292640 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292642 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.335614 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292645 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292647 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292650 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292652 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292655 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292657 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292660 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292662 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292665 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292677 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292680 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292682 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292685 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292687 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292690 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292694 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292698 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292701 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292704 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.336484 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292707 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292710 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292712 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292715 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292717 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292720 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292724 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292740 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292745 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292748 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292751 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292754 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292756 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292759 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292761 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292764 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292767 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292769 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292772 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292774 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.337360 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292782 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292785 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292788 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292796 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292800 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292804 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292806 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292810 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292813 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292815 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292817 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292820 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292823 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292827 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292830 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292833 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292835 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292838 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292841 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.338241 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292844 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292846 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292849 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292851 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292853 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292856 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292859 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292861 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292864 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292867 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292869 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292872 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292874 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292877 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292879 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292882 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292884 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292892 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292895 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292898 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.339329 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.292900 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.292905 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293064 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293069 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293072 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293075 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293078 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293081 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293084 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293087 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293091 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293094 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293097 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293100 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293103 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:01:36.340191 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293105 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293107 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293110 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293112 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293115 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293117 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293119 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293122 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293125 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293127 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293130 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293132 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293135 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293137 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293139 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293147 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293150 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293153 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293155 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293157 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:01:36.438356 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293160 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:01:36.394004 ip-10-0-138-35 systemd[1]: Started Kubernetes Kubelet. Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293163 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293165 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293167 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293170 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293172 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293174 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293178 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293180 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293184 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293187 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293189 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293192 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293194 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293197 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293200 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293202 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293206 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293210 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:01:36.439768 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293214 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293218 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293222 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293225 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293228 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293231 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293234 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293236 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293239 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293248 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293250 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293253 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293255 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293258 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293261 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293263 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293266 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293268 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293270 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293273 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:01:36.445638 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293277 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293279 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293283 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293285 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293288 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293291 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293293 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293296 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293298 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293301 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293303 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293306 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293308 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293311 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293313 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293316 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293318 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293321 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293323 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:01:36.446826 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293326 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293328 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293331 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293339 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293341 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293344 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293346 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.293349 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.293353 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.293460 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.295524 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.296943 2564 server.go:1019] "Starting client certificate rotation" Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.297053 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 12:01:36.447917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.297086 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.300477 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.346245 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.361467 2564 log.go:25] "Validated CRI v1 runtime API" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.363458 2564 log.go:25] "Validated CRI v1 image API" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.364274 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.367850 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 98d0ca0b-1b2f-4b8c-b299-b2e5eda4911c:/dev/nvme0n1p4 a99ce534-fce3-4bf8-856f-7e6e9e389133:/dev/nvme0n1p3] Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.367872 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 12:01:36.448783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.369906 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.372865 2564 manager.go:216] Machine: {Timestamp:2026-07-22 12:01:36.371588069 +0000 UTC m=+0.391978162 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110024 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28b5462f86c8df3802498c4278037d SystemUUID:ec28b546-2f86-c8df-3802-498c4278037d BootID:1d91b708-867f-4cf1-a265-eb0b549d870e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:33:8e:71:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:33:8e:71:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:a1:b3:d0:79:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.372967 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.373072 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.374082 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.374101 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.375125 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.375135 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.375143 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.375927 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.377155 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380409 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380521 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380548 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380560 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380574 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380583 2564 kubelet.go:398] "Adding apiserver pod source" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380591 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 12:01:36.449627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380970 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.380986 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.383634 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385001 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385036 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385681 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385696 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385704 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385713 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385724 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385731 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385808 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385816 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385825 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385832 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385848 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.385858 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.386460 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.386469 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.389889 2564 server.go:1268] "Started kubelet" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.389960 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.393381 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.393460 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.393480 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.393812 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.393847 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.395828 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.396279 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.399271 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.400492 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-35.ec2.internal.18c49aed504005e5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-35.ec2.internal,UID:ip-10-0-138-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-35.ec2.internal,},FirstTimestamp:2026-07-22 12:01:36.389858789 +0000 UTC m=+0.410248885,LastTimestamp:2026-07-22 12:01:36.389858789 +0000 UTC m=+0.410248885,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-35.ec2.internal,}" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.405477 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.405492 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.405682 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406076 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406081 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406098 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406178 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406186 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406371 2564 factory.go:55] Registering systemd factory Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406395 2564 factory.go:223] Registration of the systemd container factory successfully Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406611 2564 factory.go:153] Registering CRI-O factory Jul 22 12:01:36.450500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406622 2564 factory.go:223] Registration of the crio container factory successfully Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406665 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406681 2564 factory.go:103] Registering Raw factory Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406691 2564 manager.go:1196] Started watching for new ooms in manager Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.406969 2564 manager.go:349] Starting recovery of all containers Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.408281 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xchxm" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.408976 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.409024 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.416508 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xchxm" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.423375 2564 manager.go:354] Recovery completed Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.427756 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.429404 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.429427 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.429438 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.430491 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.430500 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.430502 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.430527 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.431792 2564 policy_none.go:49] "None policy: Start" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.431809 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.431821 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.432859 2564 policy_none.go:47] "Start" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.445456 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.445474 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.445499 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.452244 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.445470 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-35.ec2.internal.18c49aed529b9a31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-35.ec2.internal,UID:ip-10-0-138-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-35.ec2.internal,},FirstTimestamp:2026-07-22 12:01:36.429414961 +0000 UTC m=+0.449805054,LastTimestamp:2026-07-22 12:01:36.429414961 +0000 UTC m=+0.449805054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-35.ec2.internal,}" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.498593 2564 manager.go:337] "Starting Device Plugin manager" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.498744 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.498755 2564 server.go:87] "Starting device plugin registration server" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.498950 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.498960 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.499281 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.499344 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.499351 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.499802 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.499847 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.587101 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.588185 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.588228 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.588249 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.588286 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 12:01:36.592955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.591206 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.599599 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.600333 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.600356 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.600366 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.600388 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.608777 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.608792 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-35.ec2.internal\": node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.628751 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.688466 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal"] Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.688529 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.689309 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.689333 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.689346 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.690619 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.690770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.690793 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691390 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691408 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691423 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691692 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691708 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.691717 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.692632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.692659 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.693304 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.693323 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.693335 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:36.697474 2564 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d441b9abef2428e8e0502c51e24a66.slice/cpu.weight": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d441b9abef2428e8e0502c51e24a66.slice/cpu.weight: no such device Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.708021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d441b9abef2428e8e0502c51e24a66-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"42d441b9abef2428e8e0502c51e24a66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.708062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.713621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.708087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.727572 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-35.ec2.internal\" not found" node="ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.729077 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.737185 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-35.ec2.internal\" not found" node="ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d441b9abef2428e8e0502c51e24a66-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"42d441b9abef2428e8e0502c51e24a66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808645 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808664 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d441b9abef2428e8e0502c51e24a66-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"42d441b9abef2428e8e0502c51e24a66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:36.808668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93b6fdeff7b43c23f0fd96b244d5e1ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"93b6fdeff7b43c23f0fd96b244d5e1ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:36.861838 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.830150 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.037975 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:36.931959 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.037975 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.029736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:37.037975 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.032195 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.044743 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.041604 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:37.158389 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.133610 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.235558 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.234483 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.241501 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.295958 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.296107 2564 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.138.35:42776->98.90.111.55:6443: use of closed network connection" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.296108 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.296128 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 12:01:37.327983 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.296178 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.138.35:42776->98.90.111.55:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 12:01:37.335769 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.335335 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.571256 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.426917 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 11:56:36 +0000 UTC" deadline="2028-02-15 22:17:27.845745356 +0000 UTC" Jul 22 12:01:37.571256 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.426951 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13762h15m50.418798224s" Jul 22 12:01:37.571256 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.435669 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.571256 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.536013 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.708490 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:37.636275 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Jul 22 12:01:37.708490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.694650 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:37.708490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.705788 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Jul 22 12:01:37.830716 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.722040 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 12:01:37.830716 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.723844 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Jul 22 12:01:37.830716 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.734933 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 12:01:37.831709 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:37.831347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d441b9abef2428e8e0502c51e24a66.slice/crio-08b411dc857715931edfdb70e160381e42ce3b8812b2c1ba8e13a6c926ef2e9c WatchSource:0}: Error finding container 08b411dc857715931edfdb70e160381e42ce3b8812b2c1ba8e13a6c926ef2e9c: Status 404 returned error can't find the container with id 08b411dc857715931edfdb70e160381e42ce3b8812b2c1ba8e13a6c926ef2e9c Jul 22 12:01:37.832381 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:37.832135 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b6fdeff7b43c23f0fd96b244d5e1ca.slice/crio-11a4677feaf3108ceb789cdce03b690cede68cf1c8fdd0c23b1eea0b773fafb5 WatchSource:0}: Error finding container 11a4677feaf3108ceb789cdce03b690cede68cf1c8fdd0c23b1eea0b773fafb5: Status 404 returned error can't find the container with id 11a4677feaf3108ceb789cdce03b690cede68cf1c8fdd0c23b1eea0b773fafb5 Jul 22 12:01:37.979873 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:37.835933 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:01:38.144385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.119783 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:38.382566 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.382539 2564 apiserver.go:52] "Watching apiserver" Jul 22 12:01:38.392472 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.392441 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 12:01:38.392973 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.392941 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-n4bfw","openshift-multus/multus-wpvbv","kube-system/konnectivity-agent-m9hz6","openshift-cluster-node-tuning-operator/tuned-gqg5p","openshift-multus/network-metrics-daemon-2n65z","openshift-network-diagnostics/network-check-target-5czjs","openshift-network-operator/iptables-alerter-fk7j9","openshift-ovn-kubernetes/ovnkube-node-gxtdk","kube-system/global-pull-secret-syncer-z9tjg","kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h","openshift-dns/node-resolver-x6nkf","openshift-image-registry/node-ca-qlhgv"] Jul 22 12:01:38.394663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.394641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:38.394780 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.394722 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:38.396422 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.396399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.398012 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.397903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.398864 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.398642 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.398864 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.398679 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hpjpx\"" Jul 22 12:01:38.398864 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.398766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.400185 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.399284 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.400185 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 12:01:38.400417 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400359 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 12:01:38.400540 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.400615 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.401056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rrgw5\"" Jul 22 12:01:38.401056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.400935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.401388 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.401367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 12:01:38.401662 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.401472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kk7cg\"" Jul 22 12:01:38.401662 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.401517 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 12:01:38.402325 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.402302 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.402420 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.402382 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:38.402976 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.402911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.403304 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.403283 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.403452 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.403368 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2gl6f\"" Jul 22 12:01:38.404031 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.404011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.406294 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.405522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.406294 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.405826 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 12:01:38.406685 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.406663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.407364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.407610 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.407829 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.407966 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408004 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408283 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7c9bk\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408327 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 12:01:38.408401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.408384 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhxbd\"" Jul 22 12:01:38.409178 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.409163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.409278 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.409233 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:38.410263 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.410240 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.411181 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.411083 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 12:01:38.411698 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.411683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vbzpc\"" Jul 22 12:01:38.412360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.412162 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 12:01:38.414464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.412475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.414464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.413623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.414677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.414649 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.415665 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415547 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.415665 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 12:01:38.415820 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415800 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mmqng\"" Jul 22 12:01:38.415938 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415915 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 12:01:38.416002 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 12:01:38.416059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.416000 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6qqct\"" Jul 22 12:01:38.416059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.415923 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 12:01:38.418164 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.418039 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 12:01:38.420779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-var-lib-kubelet\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.420779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-node-log\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovn-node-metrics-cert\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-hostroot\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjqzn\" (UniqueName: \"kubernetes.io/projected/a4836812-9816-4981-b4fe-a1a614d531e3-kube-api-access-hjqzn\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-multus-daemon-config\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-run\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.420960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.420995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-var-lib-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-multus-certs\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-systemd-units\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-cni-binary-copy\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-bin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-conf\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-lib-modules\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrrx\" (UniqueName: \"kubernetes.io/projected/3f3fa6fa-209a-430f-a585-34203e650c59-kube-api-access-tnrrx\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-ovn\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cnibin\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.421354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-systemd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-system-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-kubelet\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/317c191d-3c84-4589-afa9-310f326ea742-konnectivity-ca\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-system-cni-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-systemd\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-multus\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-kubernetes\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-sys\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/317c191d-3c84-4589-afa9-310f326ea742-agent-certs\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrzr\" (UniqueName: \"kubernetes.io/projected/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-kube-api-access-nzrzr\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-etc-tuned\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chwk4\" (UniqueName: \"kubernetes.io/projected/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-kube-api-access-chwk4\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.422014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-log-socket\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-script-lib\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7fr\" (UniqueName: \"kubernetes.io/projected/4b0fccdb-8d04-43e3-b6b5-696160115f14-kube-api-access-fv7fr\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-cnibin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-conf-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-os-release\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-modprobe-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-host\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.421985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-bin\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-env-overrides\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-os-release\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-netns\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c55b3005-70cf-49ef-b15f-b890edbd8ccc-host\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppx77\" (UniqueName: \"kubernetes.io/projected/c55b3005-70cf-49ef-b15f-b890edbd8ccc-kube-api-access-ppx77\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysconfig\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-tmp\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.422811 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-slash\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-socket-dir-parent\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbxf\" (UniqueName: \"kubernetes.io/projected/cfb953d9-0662-48a1-a127-b54df59aa9bd-kube-api-access-vmbxf\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-etc-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-netd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-config\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-etc-kubernetes\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfb953d9-0662-48a1-a127-b54df59aa9bd-hosts-file\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb953d9-0662-48a1-a127-b54df59aa9bd-tmp-dir\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-kubelet\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-netns\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-k8s-cni-cncf-io\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.423464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.422786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c55b3005-70cf-49ef-b15f-b890edbd8ccc-serviceca\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.442464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.442437 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jsfws" Jul 22 12:01:38.452224 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.452197 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jsfws" Jul 22 12:01:38.507523 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.507497 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 12:01:38.523078 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.522969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-etc-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523078 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-netd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523078 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-config\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523078 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-etc-kubernetes\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523085 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-etc-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-netd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfb953d9-0662-48a1-a127-b54df59aa9bd-hosts-file\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfb953d9-0662-48a1-a127-b54df59aa9bd-hosts-file\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62723eef-96ff-4259-835b-27692670e985-host-slash\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb953d9-0662-48a1-a127-b54df59aa9bd-tmp-dir\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.523385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gh6\" (UniqueName: \"kubernetes.io/projected/15039d78-99df-40cf-8e93-557bdc6efa45-kube-api-access-x6gh6\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-kubelet\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-netns\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-k8s-cni-cncf-io\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c55b3005-70cf-49ef-b15f-b890edbd8ccc-serviceca\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-kubelet-config\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-var-lib-kubelet\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-node-log\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovn-node-metrics-cert\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-hostroot\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjqzn\" (UniqueName: \"kubernetes.io/projected/a4836812-9816-4981-b4fe-a1a614d531e3-kube-api-access-hjqzn\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-multus-daemon-config\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523682 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-netns\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-config\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-run\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523737 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.523763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-k8s-cni-cncf-io\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-var-lib-kubelet\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-node-log\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c55b3005-70cf-49ef-b15f-b890edbd8ccc-serviceca\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-hostroot\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.524401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.524799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524415 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 12:01:38.524799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb953d9-0662-48a1-a127-b54df59aa9bd-tmp-dir\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.524799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-kubelet\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.524799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.523646 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-etc-kubernetes\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.524799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgh7p\" (UniqueName: \"kubernetes.io/projected/62723eef-96ff-4259-835b-27692670e985-kube-api-access-xgh7p\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-sys-fs\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-run\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524893 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-var-lib-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-multus-certs\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.524985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-multus-certs\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-systemd-units\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.525065 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.525062 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-cni-binary-copy\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-var-lib-openvswitch\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-systemd-units\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.525180 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:01:39.025159256 +0000 UTC m=+3.045549342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-bin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-device-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-conf\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-lib-modules\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrrx\" (UniqueName: \"kubernetes.io/projected/3f3fa6fa-209a-430f-a585-34203e650c59-kube-api-access-tnrrx\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525388 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-bin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-multus-daemon-config\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-conf\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.525611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525579 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-lib-modules\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4836812-9816-4981-b4fe-a1a614d531e3-cni-binary-copy\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysctl-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-ovn\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-ovn\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cnibin\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62723eef-96ff-4259-835b-27692670e985-iptables-alerter-script\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.525989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-systemd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-system-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-kubelet\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cnibin\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/317c191d-3c84-4589-afa9-310f326ea742-konnectivity-ca\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-system-cni-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-system-cni-dir\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526213 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-run-systemd\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-system-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526331 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-kubelet\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-systemd\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.526470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-multus\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-socket-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-kubernetes\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-sys\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/317c191d-3c84-4589-afa9-310f326ea742-konnectivity-ca\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/317c191d-3c84-4589-afa9-310f326ea742-agent-certs\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzrzr\" (UniqueName: \"kubernetes.io/projected/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-kube-api-access-nzrzr\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-etc-tuned\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-systemd\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chwk4\" (UniqueName: \"kubernetes.io/projected/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-kube-api-access-chwk4\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-log-socket\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-script-lib\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-cni-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.527490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-kubernetes\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-var-lib-cni-multus\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.526990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7fr\" (UniqueName: \"kubernetes.io/projected/4b0fccdb-8d04-43e3-b6b5-696160115f14-kube-api-access-fv7fr\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-cnibin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-conf-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527155 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-sys\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-log-socket\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-os-release\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-conf-dir\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-cnibin\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-modprobe-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527356 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-os-release\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-host\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-bin\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-host\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovnkube-script-lib\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-env-overrides\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.528471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-cni-bin\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-os-release\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-modprobe-d\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-netns\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-os-release\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-host-run-netns\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c55b3005-70cf-49ef-b15f-b890edbd8ccc-host\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppx77\" (UniqueName: \"kubernetes.io/projected/c55b3005-70cf-49ef-b15f-b890edbd8ccc-kube-api-access-ppx77\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527618 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c55b3005-70cf-49ef-b15f-b890edbd8ccc-host\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-registration-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-dbus\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysconfig\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b0fccdb-8d04-43e3-b6b5-696160115f14-env-overrides\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-tmp\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527875 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f3fa6fa-209a-430f-a585-34203e650c59-etc-sysconfig\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-slash\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-socket-dir-parent\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.529554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbxf\" (UniqueName: \"kubernetes.io/projected/cfb953d9-0662-48a1-a127-b54df59aa9bd-kube-api-access-vmbxf\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.530242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.527995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b0fccdb-8d04-43e3-b6b5-696160115f14-host-slash\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.530242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.528054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.530242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.528065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4836812-9816-4981-b4fe-a1a614d531e3-multus-socket-dir-parent\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.530242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.529185 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0fccdb-8d04-43e3-b6b5-696160115f14-ovn-node-metrics-cert\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.530242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.530083 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/317c191d-3c84-4589-afa9-310f326ea742-agent-certs\") pod \"konnectivity-agent-m9hz6\" (UID: \"317c191d-3c84-4589-afa9-310f326ea742\") " pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.530493 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.530294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-tmp\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.530493 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.530341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f3fa6fa-209a-430f-a585-34203e650c59-etc-tuned\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.535328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.534886 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjqzn\" (UniqueName: \"kubernetes.io/projected/a4836812-9816-4981-b4fe-a1a614d531e3-kube-api-access-hjqzn\") pod \"multus-wpvbv\" (UID: \"a4836812-9816-4981-b4fe-a1a614d531e3\") " pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.535328 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.535293 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:38.535328 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.535329 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:38.535554 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.535344 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:38.535554 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.535460 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:01:39.035439491 +0000 UTC m=+3.055829580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:38.537152 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.537123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrrx\" (UniqueName: \"kubernetes.io/projected/3f3fa6fa-209a-430f-a585-34203e650c59-kube-api-access-tnrrx\") pod \"tuned-gqg5p\" (UID: \"3f3fa6fa-209a-430f-a585-34203e650c59\") " pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.537830 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.537632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppx77\" (UniqueName: \"kubernetes.io/projected/c55b3005-70cf-49ef-b15f-b890edbd8ccc-kube-api-access-ppx77\") pod \"node-ca-qlhgv\" (UID: \"c55b3005-70cf-49ef-b15f-b890edbd8ccc\") " pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.537830 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.537647 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chwk4\" (UniqueName: \"kubernetes.io/projected/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-kube-api-access-chwk4\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:38.539582 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.537907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzrzr\" (UniqueName: \"kubernetes.io/projected/4bdc0cbb-bd63-429f-81f1-b489ed122d2f-kube-api-access-nzrzr\") pod \"multus-additional-cni-plugins-n4bfw\" (UID: \"4bdc0cbb-bd63-429f-81f1-b489ed122d2f\") " pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.540876 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.540850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbxf\" (UniqueName: \"kubernetes.io/projected/cfb953d9-0662-48a1-a127-b54df59aa9bd-kube-api-access-vmbxf\") pod \"node-resolver-x6nkf\" (UID: \"cfb953d9-0662-48a1-a127-b54df59aa9bd\") " pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.541970 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.541943 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7fr\" (UniqueName: \"kubernetes.io/projected/4b0fccdb-8d04-43e3-b6b5-696160115f14-kube-api-access-fv7fr\") pod \"ovnkube-node-gxtdk\" (UID: \"4b0fccdb-8d04-43e3-b6b5-696160115f14\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.592462 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.592389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"93b6fdeff7b43c23f0fd96b244d5e1ca","Type":"ContainerStarted","Data":"11a4677feaf3108ceb789cdce03b690cede68cf1c8fdd0c23b1eea0b773fafb5"} Jul 22 12:01:38.593543 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.593513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" event={"ID":"42d441b9abef2428e8e0502c51e24a66","Type":"ContainerStarted","Data":"08b411dc857715931edfdb70e160381e42ce3b8812b2c1ba8e13a6c926ef2e9c"} Jul 22 12:01:38.628896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-registration-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.628896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-dbus\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62723eef-96ff-4259-835b-27692670e985-host-slash\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gh6\" (UniqueName: \"kubernetes.io/projected/15039d78-99df-40cf-8e93-557bdc6efa45-kube-api-access-x6gh6\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-kubelet-config\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-registration-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629010 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-dbus\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgh7p\" (UniqueName: \"kubernetes.io/projected/62723eef-96ff-4259-835b-27692670e985-kube-api-access-xgh7p\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.628993 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62723eef-96ff-4259-835b-27692670e985-host-slash\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629072 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-kubelet-config\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-sys-fs\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-device-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62723eef-96ff-4259-835b-27692670e985-iptables-alerter-script\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629229 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-socket-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629273 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-sys-fs\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.629449 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629494 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-socket-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:38.629512 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:01:39.129494519 +0000 UTC m=+3.149884614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:38.629831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15039d78-99df-40cf-8e93-557bdc6efa45-device-dir\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.630342 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.629888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62723eef-96ff-4259-835b-27692670e985-iptables-alerter-script\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.645518 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.645490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gh6\" (UniqueName: \"kubernetes.io/projected/15039d78-99df-40cf-8e93-557bdc6efa45-kube-api-access-x6gh6\") pod \"aws-ebs-csi-driver-node-mz75h\" (UID: \"15039d78-99df-40cf-8e93-557bdc6efa45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.645659 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.645497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgh7p\" (UniqueName: \"kubernetes.io/projected/62723eef-96ff-4259-835b-27692670e985-kube-api-access-xgh7p\") pod \"iptables-alerter-fk7j9\" (UID: \"62723eef-96ff-4259-835b-27692670e985\") " pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.710026 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.709989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x6nkf" Jul 22 12:01:38.718943 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:38.718918 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb953d9_0662_48a1_a127_b54df59aa9bd.slice/crio-740b713e63e609a9e23a73449ebb8cb3b0aa1d514547a02f27c8dc4068b5554d WatchSource:0}: Error finding container 740b713e63e609a9e23a73449ebb8cb3b0aa1d514547a02f27c8dc4068b5554d: Status 404 returned error can't find the container with id 740b713e63e609a9e23a73449ebb8cb3b0aa1d514547a02f27c8dc4068b5554d Jul 22 12:01:38.721987 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.721967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpvbv" Jul 22 12:01:38.728548 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:38.728526 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4836812_9816_4981_b4fe_a1a614d531e3.slice/crio-0b68f54ae2ab4d21e0400b8cf7968648af91508a25ae7cfaf6059033dbad1c0d WatchSource:0}: Error finding container 0b68f54ae2ab4d21e0400b8cf7968648af91508a25ae7cfaf6059033dbad1c0d: Status 404 returned error can't find the container with id 0b68f54ae2ab4d21e0400b8cf7968648af91508a25ae7cfaf6059033dbad1c0d Jul 22 12:01:38.730719 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.730698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:38.738079 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.738055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" Jul 22 12:01:38.738261 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:38.738211 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317c191d_3c84_4589_afa9_310f326ea742.slice/crio-8c65b61e6534f722589145192dbdd57048b8d8c9106f5b21293df9c8faf75ee2 WatchSource:0}: Error finding container 8c65b61e6534f722589145192dbdd57048b8d8c9106f5b21293df9c8faf75ee2: Status 404 returned error can't find the container with id 8c65b61e6534f722589145192dbdd57048b8d8c9106f5b21293df9c8faf75ee2 Jul 22 12:01:38.746165 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:38.746140 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3fa6fa_209a_430f_a585_34203e650c59.slice/crio-60d864ef592b6db3693fdade9e14ac282848e0ea655cd8f40fc7798148faa77c WatchSource:0}: Error finding container 60d864ef592b6db3693fdade9e14ac282848e0ea655cd8f40fc7798148faa77c: Status 404 returned error can't find the container with id 60d864ef592b6db3693fdade9e14ac282848e0ea655cd8f40fc7798148faa77c Jul 22 12:01:38.746987 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.746970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:01:38.754485 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:38.754459 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0fccdb_8d04_43e3_b6b5_696160115f14.slice/crio-be9e2f7ca7bdd6f2bbe2ba481bdca65d53f5fd2a6aeaf199b7b84e12f0bc3190 WatchSource:0}: Error finding container be9e2f7ca7bdd6f2bbe2ba481bdca65d53f5fd2a6aeaf199b7b84e12f0bc3190: Status 404 returned error can't find the container with id be9e2f7ca7bdd6f2bbe2ba481bdca65d53f5fd2a6aeaf199b7b84e12f0bc3190 Jul 22 12:01:38.755115 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.755095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlhgv" Jul 22 12:01:38.763920 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.763894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" Jul 22 12:01:38.773855 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.773800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fk7j9" Jul 22 12:01:38.779340 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.779322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" Jul 22 12:01:38.902026 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.901995 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:38.938363 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:38.938313 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:01:39.033051 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.032944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:39.033225 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.033109 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:39.033225 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.033187 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:01:40.033167122 +0000 UTC m=+4.053557202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:39.070632 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:39.070599 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55b3005_70cf_49ef_b15f_b890edbd8ccc.slice/crio-b76e043f5d9df951f79f5d3bf7c9589d2ceaee54ed03bc24d0c3b51a75f5e974 WatchSource:0}: Error finding container b76e043f5d9df951f79f5d3bf7c9589d2ceaee54ed03bc24d0c3b51a75f5e974: Status 404 returned error can't find the container with id b76e043f5d9df951f79f5d3bf7c9589d2ceaee54ed03bc24d0c3b51a75f5e974 Jul 22 12:01:39.073916 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:39.073888 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15039d78_99df_40cf_8e93_557bdc6efa45.slice/crio-3b1bb85eebd8beaf6a7e0d4047c81c316bd439908f6bdde6808721cb777cfddd WatchSource:0}: Error finding container 3b1bb85eebd8beaf6a7e0d4047c81c316bd439908f6bdde6808721cb777cfddd: Status 404 returned error can't find the container with id 3b1bb85eebd8beaf6a7e0d4047c81c316bd439908f6bdde6808721cb777cfddd Jul 22 12:01:39.074499 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:39.074475 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62723eef_96ff_4259_835b_27692670e985.slice/crio-52dda73998ce4c62cbbe61cbdca715d89ef83e72f3024d243afdf540b5cfbcb6 WatchSource:0}: Error finding container 52dda73998ce4c62cbbe61cbdca715d89ef83e72f3024d243afdf540b5cfbcb6: Status 404 returned error can't find the container with id 52dda73998ce4c62cbbe61cbdca715d89ef83e72f3024d243afdf540b5cfbcb6 Jul 22 12:01:39.075207 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:01:39.075178 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdc0cbb_bd63_429f_81f1_b489ed122d2f.slice/crio-c5f1970473a229f09c918f4d30ab62ce08f0ead8f11bfa5a727c3818660930ad WatchSource:0}: Error finding container c5f1970473a229f09c918f4d30ab62ce08f0ead8f11bfa5a727c3818660930ad: Status 404 returned error can't find the container with id c5f1970473a229f09c918f4d30ab62ce08f0ead8f11bfa5a727c3818660930ad Jul 22 12:01:39.133528 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.133489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:39.133528 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.133527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:39.133746 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133644 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:39.133746 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133643 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:39.133746 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:01:40.133693771 +0000 UTC m=+4.154083866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:39.133746 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133657 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:39.133746 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133746 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:39.133983 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.133804 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:01:40.133791897 +0000 UTC m=+4.154181995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:39.455231 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.454974 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:56:38 +0000 UTC" deadline="2028-01-18 15:24:25.162000584 +0000 UTC" Jul 22 12:01:39.455231 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.455230 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13083h22m45.706776873s" Jul 22 12:01:39.588577 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.588473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:39.588726 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:39.588595 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:39.597866 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.597794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fk7j9" event={"ID":"62723eef-96ff-4259-835b-27692670e985","Type":"ContainerStarted","Data":"52dda73998ce4c62cbbe61cbdca715d89ef83e72f3024d243afdf540b5cfbcb6"} Jul 22 12:01:39.601657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.601576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlhgv" event={"ID":"c55b3005-70cf-49ef-b15f-b890edbd8ccc","Type":"ContainerStarted","Data":"b76e043f5d9df951f79f5d3bf7c9589d2ceaee54ed03bc24d0c3b51a75f5e974"} Jul 22 12:01:39.604550 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.604473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" event={"ID":"3f3fa6fa-209a-430f-a585-34203e650c59","Type":"ContainerStarted","Data":"60d864ef592b6db3693fdade9e14ac282848e0ea655cd8f40fc7798148faa77c"} Jul 22 12:01:39.606458 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.606379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m9hz6" event={"ID":"317c191d-3c84-4589-afa9-310f326ea742","Type":"ContainerStarted","Data":"8c65b61e6534f722589145192dbdd57048b8d8c9106f5b21293df9c8faf75ee2"} Jul 22 12:01:39.608686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.608661 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpvbv" event={"ID":"a4836812-9816-4981-b4fe-a1a614d531e3","Type":"ContainerStarted","Data":"0b68f54ae2ab4d21e0400b8cf7968648af91508a25ae7cfaf6059033dbad1c0d"} Jul 22 12:01:39.610913 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.610848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x6nkf" event={"ID":"cfb953d9-0662-48a1-a127-b54df59aa9bd","Type":"ContainerStarted","Data":"740b713e63e609a9e23a73449ebb8cb3b0aa1d514547a02f27c8dc4068b5554d"} Jul 22 12:01:39.613714 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.613655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerStarted","Data":"c5f1970473a229f09c918f4d30ab62ce08f0ead8f11bfa5a727c3818660930ad"} Jul 22 12:01:39.617003 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.616979 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" event={"ID":"15039d78-99df-40cf-8e93-557bdc6efa45","Type":"ContainerStarted","Data":"3b1bb85eebd8beaf6a7e0d4047c81c316bd439908f6bdde6808721cb777cfddd"} Jul 22 12:01:39.619135 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.619027 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"be9e2f7ca7bdd6f2bbe2ba481bdca65d53f5fd2a6aeaf199b7b84e12f0bc3190"} Jul 22 12:01:39.622626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.622445 2564 generic.go:356] "Generic (PLEG): container finished" podID="93b6fdeff7b43c23f0fd96b244d5e1ca" containerID="7a7f452e2232ba0f589248773fbcfd5a5a856e8c97409c67251708e5aad8d2f6" exitCode=0 Jul 22 12:01:39.622626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:39.622477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"93b6fdeff7b43c23f0fd96b244d5e1ca","Type":"ContainerDied","Data":"7a7f452e2232ba0f589248773fbcfd5a5a856e8c97409c67251708e5aad8d2f6"} Jul 22 12:01:40.041393 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.041310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:40.041569 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.041465 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:40.041569 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.041531 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:01:42.041512099 +0000 UTC m=+6.061902183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:40.142298 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.142261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:40.142480 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.142312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:40.142480 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142397 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:40.142480 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142458 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:40.142480 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142474 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:40.142688 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142488 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:40.142688 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142471 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:01:42.142450464 +0000 UTC m=+6.162840547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:40.142688 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.142557 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:01:42.142542011 +0000 UTC m=+6.162932097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:40.456227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.456136 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:56:38 +0000 UTC" deadline="2028-04-19 03:59:00.836678306 +0000 UTC" Jul 22 12:01:40.456227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.456182 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15279h57m20.380501215s" Jul 22 12:01:40.590213 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.590172 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:40.590372 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.590318 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:40.592630 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:40.592604 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:40.592765 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:40.592705 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:41.589431 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:41.589012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:41.589431 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:41.589157 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:42.057951 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:42.057872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:42.058127 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.058015 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:42.058127 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.058092 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:01:46.058074007 +0000 UTC m=+10.078464105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:42.158345 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:42.158305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:42.158509 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:42.158354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:42.158509 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158495 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:42.158624 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158514 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:42.158624 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158527 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:42.158624 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158579 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:01:46.158561939 +0000 UTC m=+10.178952035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:42.158775 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158650 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:42.158775 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.158685 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:01:46.158674557 +0000 UTC m=+10.179064641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:42.589637 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:42.589164 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:42.589637 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.589289 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:42.590395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:42.590246 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:42.590395 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:42.590351 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:43.589478 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:43.589401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:43.589627 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:43.589565 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:44.589442 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:44.589360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:44.589861 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:44.589372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:44.589861 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:44.589504 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:44.589861 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:44.589574 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:45.588674 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:45.588644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:45.588853 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:45.588774 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:46.093623 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:46.093586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:46.094086 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.093729 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:46.094086 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.093793 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:01:54.093777525 +0000 UTC m=+18.114167606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:46.194530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:46.194583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194726 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194752 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194774 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194788 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194810 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:01:54.194788817 +0000 UTC m=+18.215178921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:46.194875 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.194838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:01:54.19482226 +0000 UTC m=+18.215212362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:46.589493 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:46.589421 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:46.590934 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:46.590390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:46.590934 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.590499 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:46.590934 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:46.590883 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:47.589151 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:47.589117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:47.589633 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:47.589329 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:48.588773 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:48.588738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:48.588946 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:48.588898 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:48.588946 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:48.588922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:48.589087 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:48.589003 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:49.588661 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:49.588626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:49.589173 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:49.588742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:50.589299 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:50.589263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:50.589771 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:50.589415 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:50.589771 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:50.589479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:50.589771 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:50.589603 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:51.589288 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:51.589248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:51.589434 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:51.589365 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:52.589337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:52.589298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:52.589337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:52.589320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:52.589918 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:52.589446 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:52.589918 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:52.589551 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:53.588660 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:53.588622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:53.588861 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:53.588752 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:54.152894 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:54.152862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:54.153336 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.153011 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:54.153336 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.153103 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:10.153076391 +0000 UTC m=+34.173466475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:01:54.253541 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:54.253501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:54.253695 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:54.253549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:54.253695 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253665 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:54.253796 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253737 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:02:10.25372253 +0000 UTC m=+34.274112611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:01:54.253796 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253679 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:01:54.253796 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253786 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:01:54.253796 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253796 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:54.253954 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.253856 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:02:10.253839077 +0000 UTC m=+34.274229171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:01:54.589155 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:54.589122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:54.589337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:54.589130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:54.589337 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.589241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:54.589450 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:54.589334 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:55.588750 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:55.588712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:55.589217 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:55.588839 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:56.589945 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:56.589915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:56.590353 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:56.590055 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:56.590353 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:56.590069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:56.590353 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:56.590197 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:57.589273 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:57.589244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:57.589443 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:57.589366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:58.589434 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.589322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:01:58.590154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.589393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:01:58.590154 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:58.589536 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:01:58.590154 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:58.589577 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:01:58.679504 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.679475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m9hz6" event={"ID":"317c191d-3c84-4589-afa9-310f326ea742","Type":"ContainerStarted","Data":"43790a63f40ff94ade0f4565b93eb8da707b1551d4904206dcd7578cc0639f35"} Jul 22 12:01:58.680931 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.680907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpvbv" event={"ID":"a4836812-9816-4981-b4fe-a1a614d531e3","Type":"ContainerStarted","Data":"24086f0984f59ffa96448990298c909613460c981ff56e9666d023391caceb1d"} Jul 22 12:01:58.682325 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.682305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x6nkf" event={"ID":"cfb953d9-0662-48a1-a127-b54df59aa9bd","Type":"ContainerStarted","Data":"1f447bb28259d3825edc0acb421674bd97f716c003f83f9febaf30572a0baeac"} Jul 22 12:01:58.683864 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.683844 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="7ee5310c9bad73563ae1e0aedb1de3c6849bbf77ff17ef4b7c6cc1b590367c65" exitCode=0 Jul 22 12:01:58.683939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.683907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"7ee5310c9bad73563ae1e0aedb1de3c6849bbf77ff17ef4b7c6cc1b590367c65"} Jul 22 12:01:58.685362 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.685345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" event={"ID":"15039d78-99df-40cf-8e93-557bdc6efa45","Type":"ContainerStarted","Data":"20a2ca86bfd5994e150be39d4de37275465d17a093e75c902a8023f207a76017"} Jul 22 12:01:58.687034 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.687015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"c0de73e6d347d4e33a2aed8519249bbc588be5860af1eca37b52707a1bf8edb1"} Jul 22 12:01:58.687129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.687103 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"e71233b93c2f099179bf89c0900452cca04bb2cd66cdd68951ca2d0e0a4592bd"} Jul 22 12:01:58.688693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.688671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"93b6fdeff7b43c23f0fd96b244d5e1ca","Type":"ContainerStarted","Data":"d86163a9f580b99e8716851595a41b24c867cc92350161f0fc896eca9b3dee71"} Jul 22 12:01:58.689979 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.689958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" event={"ID":"42d441b9abef2428e8e0502c51e24a66","Type":"ContainerStarted","Data":"116dd278f7d6a1ac9bc02a78c79ed51abb6876f05b0d68215240fee39f0cebfc"} Jul 22 12:01:58.691117 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.691099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlhgv" event={"ID":"c55b3005-70cf-49ef-b15f-b890edbd8ccc","Type":"ContainerStarted","Data":"1f21e1c94d42b2dce3283ee1c6a556dcd2d217c9d5b4c769023f36b027dafe36"} Jul 22 12:01:58.692384 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.692359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" event={"ID":"3f3fa6fa-209a-430f-a585-34203e650c59","Type":"ContainerStarted","Data":"7b23f1fb99a549a4004b1526dbc2d6f8e92276654d8cd8afb6439691bad886cf"} Jul 22 12:01:58.696963 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.696923 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m9hz6" podStartSLOduration=3.356831816 podStartE2EDuration="22.696913218s" totalImagesPullingTime="19.340081402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.696716342 +0000 UTC m=+22.717106445" watchObservedRunningTime="2026-07-22 12:01:58.696913218 +0000 UTC m=+22.717303321" Jul 22 12:01:58.715663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.715632 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qlhgv" podStartSLOduration=3.623764512 podStartE2EDuration="22.715620628s" totalImagesPullingTime="19.091856116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.71546465 +0000 UTC m=+22.735854752" watchObservedRunningTime="2026-07-22 12:01:58.715620628 +0000 UTC m=+22.736010730" Jul 22 12:01:58.758500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.758470 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" podStartSLOduration=21.758458865 podStartE2EDuration="21.758458865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.75818947 +0000 UTC m=+22.778579573" watchObservedRunningTime="2026-07-22 12:01:58.758458865 +0000 UTC m=+22.778848968" Jul 22 12:01:58.781224 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.781184 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" podStartSLOduration=21.781169502 podStartE2EDuration="21.781169502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.780959482 +0000 UTC m=+22.801349586" watchObservedRunningTime="2026-07-22 12:01:58.781169502 +0000 UTC m=+22.801559605" Jul 22 12:01:58.801667 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.801574 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x6nkf" podStartSLOduration=3.357497241 podStartE2EDuration="22.801536387s" totalImagesPullingTime="19.444039146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.798973851 +0000 UTC m=+22.819363957" watchObservedRunningTime="2026-07-22 12:01:58.801536387 +0000 UTC m=+22.821926470" Jul 22 12:01:58.844572 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.844536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wpvbv" podStartSLOduration=3.166627878 podStartE2EDuration="22.844523734s" totalImagesPullingTime="19.677895856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.821731892 +0000 UTC m=+22.842122005" watchObservedRunningTime="2026-07-22 12:01:58.844523734 +0000 UTC m=+22.864913836" Jul 22 12:01:58.844701 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:58.844682 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gqg5p" podStartSLOduration=3.452579386 podStartE2EDuration="22.844672357s" totalImagesPullingTime="19.392092971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:58.844141321 +0000 UTC m=+22.864531425" watchObservedRunningTime="2026-07-22 12:01:58.844672357 +0000 UTC m=+22.865062463" Jul 22 12:01:59.589119 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.589095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:01:59.589223 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:01:59.589195 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:01:59.667237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.667216 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 12:01:59.695813 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.695785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fk7j9" event={"ID":"62723eef-96ff-4259-835b-27692670e985","Type":"ContainerStarted","Data":"f15ffc9aa2ffe2ec19bf767d45ef9b3ae6dbc395b23daaa3b2f2bc8fc59ded4e"} Jul 22 12:01:59.697561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.697538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" event={"ID":"15039d78-99df-40cf-8e93-557bdc6efa45","Type":"ContainerStarted","Data":"169c0548f32c7bc222805acc8dd418b848000cf96aef27b37a6ea0be991cab04"} Jul 22 12:01:59.700145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.700109 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"927a0b3765baca5cac6953c8d70ed01a28978721137ac2629d3d1e43733d9851"} Jul 22 12:01:59.700250 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.700201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"9493bfe53c4092af435602f3c4fa3a47a10a277a5d2a94be25076152716c79de"} Jul 22 12:01:59.700313 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.700252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"1d8ae4c8ca7d554025bd5636a2cc1c47c8689f7e1f24a5223d1b83c5fa0080d7"} Jul 22 12:01:59.700372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.700316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"670e8e294ef84e9874459e8973ca0976ab380d2bba71079f8a9d9f138ab1715a"} Jul 22 12:01:59.718559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.718522 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fk7j9" podStartSLOduration=4.725430969 podStartE2EDuration="23.718508717s" totalImagesPullingTime="18.993077748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:59.71811614 +0000 UTC m=+23.738506237" watchObservedRunningTime="2026-07-22 12:01:59.718508717 +0000 UTC m=+23.738898820" Jul 22 12:01:59.856553 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.856506 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:01:59.856991 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:01:59.856974 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:02:00.518442 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.518329 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T12:01:59.667232421Z","UUID":"3811675c-073d-4ec7-a202-01a73805d1c6","Handler":null,"Name":"","Endpoint":""} Jul 22 12:02:00.520110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.519909 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 12:02:00.520110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.519952 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 12:02:00.589429 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.589405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:00.589567 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:00.589519 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:00.589654 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.589578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:00.589708 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:00.589667 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:00.702342 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.702137 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:02:00.702744 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:00.702715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m9hz6" Jul 22 12:02:01.589053 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:01.589009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:01.589236 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:01.589149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:02:01.706193 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:01.706148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" event={"ID":"15039d78-99df-40cf-8e93-557bdc6efa45","Type":"ContainerStarted","Data":"8e8ca6e51f703d36d03b0ad9c0b82e5f7b46b46ba137646e99951d32bb289d0d"} Jul 22 12:02:01.709904 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:01.709877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"1afe1d044c908e182fef2b6695e0b900bf86f04f7977191a3ef3a22a2e4e63d8"} Jul 22 12:02:02.589488 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:02.589282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:02.589712 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:02.589327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:02.589712 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:02.589608 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:02.589712 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:02.589668 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:03.588603 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.588583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:03.588925 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:03.588668 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:02:03.717329 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.717303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" event={"ID":"4b0fccdb-8d04-43e3-b6b5-696160115f14","Type":"ContainerStarted","Data":"b0664c9cbf8ac252776b9ce4c4221d5879a6711b2ef185f6033b6b6b359d3dd4"} Jul 22 12:02:03.717714 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.717671 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:03.733860 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.733746 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:03.746581 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.746546 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" podStartSLOduration=8.288520079 podStartE2EDuration="27.746532823s" totalImagesPullingTime="19.458012744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:03.746376627 +0000 UTC m=+27.766766731" watchObservedRunningTime="2026-07-22 12:02:03.746532823 +0000 UTC m=+27.766922925" Jul 22 12:02:03.746737 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:03.746720 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz75h" podStartSLOduration=6.493833106 podStartE2EDuration="27.746715867s" totalImagesPullingTime="21.252882761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:01.731862155 +0000 UTC m=+25.752252259" watchObservedRunningTime="2026-07-22 12:02:03.746715867 +0000 UTC m=+27.767105970" Jul 22 12:02:04.152950 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.152893 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:04.593865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.593835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:04.594426 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:04.593966 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:04.594426 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.594009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:04.594426 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:04.594115 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:04.720838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.720811 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="87f22648218aaf7e87744753f58507b938baa4431b872b17274f4eaf100d297a" exitCode=0 Jul 22 12:02:04.720960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.720891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"87f22648218aaf7e87744753f58507b938baa4431b872b17274f4eaf100d297a"} Jul 22 12:02:04.721986 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.721487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:04.737596 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:04.737578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:05.570770 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.570736 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z9tjg"] Jul 22 12:02:05.570948 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.570844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:05.571014 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:05.570956 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:05.573825 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.573800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5czjs"] Jul 22 12:02:05.573943 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.573899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:05.574004 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:05.573987 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:02:05.574343 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.574322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2n65z"] Jul 22 12:02:05.574412 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:05.574397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:05.574517 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:05.574495 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:06.591339 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:06.591313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:06.591673 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:06.591405 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:07.588972 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:07.588939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:07.589168 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:07.588939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:07.589168 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:07.589090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:07.589168 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:07.589120 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:02:08.589032 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:08.588848 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:08.589474 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:08.589158 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:08.731753 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:08.731714 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="99b42699ff691c354af10d85b63d740297721e635ccb60ba4b516472df502649" exitCode=0 Jul 22 12:02:08.731868 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:08.731785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"99b42699ff691c354af10d85b63d740297721e635ccb60ba4b516472df502649"} Jul 22 12:02:09.588772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:09.588748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:09.588888 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:09.588864 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5czjs" podUID="1dd4359e-83a5-4332-bf59-16167f9b37ae" Jul 22 12:02:09.588954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:09.588903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:09.589003 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:09.588974 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2n65z" podUID="828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99" Jul 22 12:02:09.736392 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:09.736364 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="199b09a1f5d29a2f3d025b1ecf0b024f8c153652818ebd15963db40dc4aadc0a" exitCode=0 Jul 22 12:02:09.736727 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:09.736417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"199b09a1f5d29a2f3d025b1ecf0b024f8c153652818ebd15963db40dc4aadc0a"} Jul 22 12:02:10.179774 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:10.179744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:10.179923 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.179869 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:02:10.179923 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.179921 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:42.179906749 +0000 UTC m=+66.200296834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:02:10.280214 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:10.280181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:10.280357 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:10.280223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:10.280357 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280280 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:02:10.280357 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280338 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret podName:abb4b91e-07e3-4a38-93c9-738f4cdffb8c nodeName:}" failed. No retries permitted until 2026-07-22 12:02:42.280319451 +0000 UTC m=+66.300709551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret") pod "global-pull-secret-syncer-z9tjg" (UID: "abb4b91e-07e3-4a38-93c9-738f4cdffb8c") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:02:10.280357 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280347 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:02:10.280553 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280370 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:02:10.280553 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280383 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hrnhg for pod openshift-network-diagnostics/network-check-target-5czjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:02:10.280553 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.280435 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg podName:1dd4359e-83a5-4332-bf59-16167f9b37ae nodeName:}" failed. No retries permitted until 2026-07-22 12:02:42.280418905 +0000 UTC m=+66.300808988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrnhg" (UniqueName: "kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg") pod "network-check-target-5czjs" (UID: "1dd4359e-83a5-4332-bf59-16167f9b37ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:02:10.588989 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:10.588961 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:10.589180 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:10.589128 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9tjg" podUID="abb4b91e-07e3-4a38-93c9-738f4cdffb8c" Jul 22 12:02:11.316815 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.316789 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeReady" Jul 22 12:02:11.317256 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.316883 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 12:02:11.366821 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.366796 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lfz8n"] Jul 22 12:02:11.368962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.368941 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v6z4l"] Jul 22 12:02:11.369147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.369114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.370741 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.370716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.371475 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.371240 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 12:02:11.371475 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.371323 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 12:02:11.371475 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.371365 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9wgb\"" Jul 22 12:02:11.374084 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.373753 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 12:02:11.374084 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.373893 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 12:02:11.374084 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.374004 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-82grb\"" Jul 22 12:02:11.374385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.374212 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 12:02:11.381233 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.380863 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6z4l"] Jul 22 12:02:11.386767 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.386382 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfz8n"] Jul 22 12:02:11.489187 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3deab09-41a9-4ad6-8742-fb23987876c4-config-volume\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.489337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppgn\" (UniqueName: \"kubernetes.io/projected/f3deab09-41a9-4ad6-8742-fb23987876c4-kube-api-access-zppgn\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.489337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhbp\" (UniqueName: \"kubernetes.io/projected/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-kube-api-access-hmhbp\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.489337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3deab09-41a9-4ad6-8742-fb23987876c4-tmp-dir\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.489337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.489337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.489304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-cert\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.589177 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:11.589287 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:11.589656 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-cert\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.589775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3deab09-41a9-4ad6-8742-fb23987876c4-config-volume\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.589775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zppgn\" (UniqueName: \"kubernetes.io/projected/f3deab09-41a9-4ad6-8742-fb23987876c4-kube-api-access-zppgn\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.589884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhbp\" (UniqueName: \"kubernetes.io/projected/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-kube-api-access-hmhbp\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.589884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3deab09-41a9-4ad6-8742-fb23987876c4-tmp-dir\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.589884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.589851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.590019 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:11.589960 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:11.590019 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:11.590017 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:12.089998332 +0000 UTC m=+36.110388415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:11.590300 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.590275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3deab09-41a9-4ad6-8742-fb23987876c4-tmp-dir\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.590389 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.590334 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3deab09-41a9-4ad6-8742-fb23987876c4-config-volume\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.591645 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.591620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 12:02:11.591849 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.591824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 12:02:11.591943 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.591883 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 12:02:11.592006 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.591824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-856ws\"" Jul 22 12:02:11.592075 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.592008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4n945\"" Jul 22 12:02:11.594892 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.594871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-cert\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.599053 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.599019 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppgn\" (UniqueName: \"kubernetes.io/projected/f3deab09-41a9-4ad6-8742-fb23987876c4-kube-api-access-zppgn\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:11.599400 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.599384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhbp\" (UniqueName: \"kubernetes.io/projected/7ac0d182-1afb-48a2-8bf3-1be8486c5ea9-kube-api-access-hmhbp\") pod \"ingress-canary-v6z4l\" (UID: \"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9\") " pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.692098 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.692080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6z4l" Jul 22 12:02:11.838909 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:11.838719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6z4l"] Jul 22 12:02:11.842534 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:02:11.842499 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac0d182_1afb_48a2_8bf3_1be8486c5ea9.slice/crio-bf7ca0ed579bab11d37bccd6006920329a445cb78a4058ff0ef184d7bd54d21c WatchSource:0}: Error finding container bf7ca0ed579bab11d37bccd6006920329a445cb78a4058ff0ef184d7bd54d21c: Status 404 returned error can't find the container with id bf7ca0ed579bab11d37bccd6006920329a445cb78a4058ff0ef184d7bd54d21c Jul 22 12:02:12.095449 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:12.095374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:12.095590 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:12.095546 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:12.095645 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:12.095631 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:13.095609402 +0000 UTC m=+37.115999482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:12.588866 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:12.588832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:12.591695 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:12.591675 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 12:02:12.745255 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:12.745218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6z4l" event={"ID":"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9","Type":"ContainerStarted","Data":"bf7ca0ed579bab11d37bccd6006920329a445cb78a4058ff0ef184d7bd54d21c"} Jul 22 12:02:13.102123 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:13.102079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:13.102284 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:13.102191 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:13.102284 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:13.102252 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:15.102234907 +0000 UTC m=+39.122624988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:13.751096 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:13.751068 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="f159c495b3722a1a82f344f7db4bac357b7dc3b25e47056d6aaef3c066f4b515" exitCode=0 Jul 22 12:02:13.751527 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:13.751116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"f159c495b3722a1a82f344f7db4bac357b7dc3b25e47056d6aaef3c066f4b515"} Jul 22 12:02:14.757572 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:14.757541 2564 generic.go:356] "Generic (PLEG): container finished" podID="4bdc0cbb-bd63-429f-81f1-b489ed122d2f" containerID="e5d83e8aeba779447fde512af270e1b89e87cec39dbc116207f340951f417496" exitCode=0 Jul 22 12:02:14.757970 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:14.757613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerDied","Data":"e5d83e8aeba779447fde512af270e1b89e87cec39dbc116207f340951f417496"} Jul 22 12:02:15.116780 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:15.116742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:15.116954 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:15.116915 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:15.117018 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:15.116984 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:19.116967749 +0000 UTC m=+43.137357830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:15.763315 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:15.763082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" event={"ID":"4bdc0cbb-bd63-429f-81f1-b489ed122d2f","Type":"ContainerStarted","Data":"eff725393c28694a08db8ce5f6efd0276217e0dd9337ac5aacdf8bea4c8bea03"} Jul 22 12:02:15.764511 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:15.764485 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6z4l" event={"ID":"7ac0d182-1afb-48a2-8bf3-1be8486c5ea9","Type":"ContainerStarted","Data":"6e121884ec07377a2a0cc9a3afc2f500974f2620cbde4f76bae9af6ab1ef8fa9"} Jul 22 12:02:15.801920 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:15.801871 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n4bfw" podStartSLOduration=7.846355687 podStartE2EDuration="39.80185211s" totalImagesPullingTime="31.955496423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:15.801175963 +0000 UTC m=+39.821566066" watchObservedRunningTime="2026-07-22 12:02:15.80185211 +0000 UTC m=+39.822242214" Jul 22 12:02:15.820191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:15.820148 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v6z4l" podStartSLOduration=1.26002497 podStartE2EDuration="4.820136196s" totalImagesPullingTime="3.560111226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:15.819902944 +0000 UTC m=+39.840293047" watchObservedRunningTime="2026-07-22 12:02:15.820136196 +0000 UTC m=+39.840526277" Jul 22 12:02:19.145369 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:19.145328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:19.145769 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:19.145450 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:19.145769 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:19.145516 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:27.145499551 +0000 UTC m=+51.165889632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:27.196992 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:27.196950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:27.197461 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:27.197138 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:27.197461 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:27.197215 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:02:43.197198693 +0000 UTC m=+67.217588773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:36.735860 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:36.735830 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxtdk" Jul 22 12:02:42.199140 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.199084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:02:42.201710 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.201690 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 12:02:42.209672 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:42.209655 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 12:02:42.209739 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:42.209728 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs podName:828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:46.209706036 +0000 UTC m=+130.230096120 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs") pod "network-metrics-daemon-2n65z" (UID: "828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99") : secret "metrics-daemon-secret" not found Jul 22 12:02:42.300236 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.300205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:42.300321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.300242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:42.302824 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.302805 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 12:02:42.302864 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.302804 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 12:02:42.313055 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.313025 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 12:02:42.314354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.314333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abb4b91e-07e3-4a38-93c9-738f4cdffb8c-original-pull-secret\") pod \"global-pull-secret-syncer-z9tjg\" (UID: \"abb4b91e-07e3-4a38-93c9-738f4cdffb8c\") " pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:42.323932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.323908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnhg\" (UniqueName: \"kubernetes.io/projected/1dd4359e-83a5-4332-bf59-16167f9b37ae-kube-api-access-hrnhg\") pod \"network-check-target-5czjs\" (UID: \"1dd4359e-83a5-4332-bf59-16167f9b37ae\") " pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:42.518228 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.518153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-856ws\"" Jul 22 12:02:42.526215 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.526192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:42.599221 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.599197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9tjg" Jul 22 12:02:42.648778 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.648743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5czjs"] Jul 22 12:02:42.723789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.723753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z9tjg"] Jul 22 12:02:42.727496 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:02:42.727472 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb4b91e_07e3_4a38_93c9_738f4cdffb8c.slice/crio-4c9914ac25c78895d37d8939a76ce8e9d8796562885207b146cb94d494e26a6b WatchSource:0}: Error finding container 4c9914ac25c78895d37d8939a76ce8e9d8796562885207b146cb94d494e26a6b: Status 404 returned error can't find the container with id 4c9914ac25c78895d37d8939a76ce8e9d8796562885207b146cb94d494e26a6b Jul 22 12:02:42.827333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.827298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z9tjg" event={"ID":"abb4b91e-07e3-4a38-93c9-738f4cdffb8c","Type":"ContainerStarted","Data":"4c9914ac25c78895d37d8939a76ce8e9d8796562885207b146cb94d494e26a6b"} Jul 22 12:02:42.828294 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:42.828271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5czjs" event={"ID":"1dd4359e-83a5-4332-bf59-16167f9b37ae","Type":"ContainerStarted","Data":"f7392fb10bf2703f2e2cab6ca9b8c72998b3a776a4553c7ef641ba628fd45f93"} Jul 22 12:02:43.206344 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:43.206260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:02:43.206751 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:43.206396 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:02:43.206751 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:02:43.206480 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:15.20645869 +0000 UTC m=+99.226848773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:02:47.844146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:47.844099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z9tjg" event={"ID":"abb4b91e-07e3-4a38-93c9-738f4cdffb8c","Type":"ContainerStarted","Data":"ba4d419d85fb4cc6c2aa954d08a14bc30d0ef1438600f3c578f92fbdee7adce8"} Jul 22 12:02:47.845807 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:47.845774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5czjs" event={"ID":"1dd4359e-83a5-4332-bf59-16167f9b37ae","Type":"ContainerStarted","Data":"d9d05fef7184c9eaa41d19f954400c34df8db3e52a1135ae02ad61e098842f58"} Jul 22 12:02:47.845960 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:47.845932 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:02:47.861838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:47.861790 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z9tjg" podStartSLOduration=67.605937515 podStartE2EDuration="1m11.861775406s" totalImagesPullingTime="4.255837891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:47.860760752 +0000 UTC m=+71.881150854" watchObservedRunningTime="2026-07-22 12:02:47.861775406 +0000 UTC m=+71.882165507" Jul 22 12:02:47.878646 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:02:47.878601 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5czjs" podStartSLOduration=67.557038687 podStartE2EDuration="1m11.878583295s" totalImagesPullingTime="4.321544608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:47.877817244 +0000 UTC m=+71.898207345" watchObservedRunningTime="2026-07-22 12:02:47.878583295 +0000 UTC m=+71.898973399" Jul 22 12:03:02.481195 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.480991 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-thvgj"] Jul 22 12:03:02.483723 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.483704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.485948 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.485918 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 12:03:02.486093 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.485993 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wbkz2\"" Jul 22 12:03:02.492254 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.492229 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 12:03:02.492438 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.492273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 12:03:02.492438 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.492291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 12:03:02.498634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.498608 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 12:03:02.498851 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.498826 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-thvgj"] Jul 22 12:03:02.530228 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-snapshots\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.530372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf85f063-1b03-4c87-af1d-1284fa950651-serving-cert\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.530372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.530372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-tmp\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.530372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-service-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.530529 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.530402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkj9\" (UniqueName: \"kubernetes.io/projected/bf85f063-1b03-4c87-af1d-1284fa950651-kube-api-access-jbkj9\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631532 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-snapshots\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf85f063-1b03-4c87-af1d-1284fa950651-serving-cert\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-tmp\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-service-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.631643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.631616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkj9\" (UniqueName: \"kubernetes.io/projected/bf85f063-1b03-4c87-af1d-1284fa950651-kube-api-access-jbkj9\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.632218 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.632190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-tmp\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.632308 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.632236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf85f063-1b03-4c87-af1d-1284fa950651-snapshots\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.632308 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.632272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-service-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.632626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.632605 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf85f063-1b03-4c87-af1d-1284fa950651-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.634139 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.634115 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf85f063-1b03-4c87-af1d-1284fa950651-serving-cert\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.640848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.640821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkj9\" (UniqueName: \"kubernetes.io/projected/bf85f063-1b03-4c87-af1d-1284fa950651-kube-api-access-jbkj9\") pod \"insights-operator-555d9d7885-thvgj\" (UID: \"bf85f063-1b03-4c87-af1d-1284fa950651\") " pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.792872 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.792850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-thvgj" Jul 22 12:03:02.921196 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:02.921169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-thvgj"] Jul 22 12:03:02.924347 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:02.924320 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf85f063_1b03_4c87_af1d_1284fa950651.slice/crio-30a19bf69b733ae0e243512b7457a50ca3986069a4d6713aa5d0f0564bb6f036 WatchSource:0}: Error finding container 30a19bf69b733ae0e243512b7457a50ca3986069a4d6713aa5d0f0564bb6f036: Status 404 returned error can't find the container with id 30a19bf69b733ae0e243512b7457a50ca3986069a4d6713aa5d0f0564bb6f036 Jul 22 12:03:03.886118 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:03.886084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-thvgj" event={"ID":"bf85f063-1b03-4c87-af1d-1284fa950651","Type":"ContainerStarted","Data":"30a19bf69b733ae0e243512b7457a50ca3986069a4d6713aa5d0f0564bb6f036"} Jul 22 12:03:05.892267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:05.892239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-thvgj" event={"ID":"bf85f063-1b03-4c87-af1d-1284fa950651","Type":"ContainerStarted","Data":"fb8eb07dcd03dc30fbfb3026ec48960e9abe9112588a83fa40f16da9eb8f083d"} Jul 22 12:03:05.926776 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:05.926735 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-thvgj" podStartSLOduration=1.078904543 podStartE2EDuration="3.926720939s" totalImagesPullingTime="2.847816396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:05.925775612 +0000 UTC m=+89.946165726" watchObservedRunningTime="2026-07-22 12:03:05.926720939 +0000 UTC m=+89.947111070" Jul 22 12:03:06.811514 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.811479 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhjs"] Jul 22 12:03:06.813959 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.813938 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.818439 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:06.818400 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-jrhjs\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" podUID="c768555a-20ee-44fe-ada2-685e74ca4583" pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.818570 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:06.818550 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-tmstd\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmstd\"" type="*v1.Secret" Jul 22 12:03:06.819074 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:06.819015 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jul 22 12:03:06.819215 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:06.819194 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jul 22 12:03:06.828082 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.828056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhjs"] Jul 22 12:03:06.858917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.858895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5nnj\" (UniqueName: \"kubernetes.io/projected/c768555a-20ee-44fe-ada2-685e74ca4583-kube-api-access-f5nnj\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.859007 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.858929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c768555a-20ee-44fe-ada2-685e74ca4583-data-volume\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.859007 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.858962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.859121 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.859007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c768555a-20ee-44fe-ada2-685e74ca4583-crio-socket\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.859121 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.859026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960084 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960417 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c768555a-20ee-44fe-ada2-685e74ca4583-crio-socket\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960417 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960417 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5nnj\" (UniqueName: \"kubernetes.io/projected/c768555a-20ee-44fe-ada2-685e74ca4583-kube-api-access-f5nnj\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960417 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c768555a-20ee-44fe-ada2-685e74ca4583-data-volume\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c768555a-20ee-44fe-ada2-685e74ca4583-crio-socket\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.960628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.960557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c768555a-20ee-44fe-ada2-685e74ca4583-data-volume\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:06.970581 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:06.970555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5nnj\" (UniqueName: \"kubernetes.io/projected/c768555a-20ee-44fe-ada2-685e74ca4583-kube-api-access-f5nnj\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:07.759985 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:07.759963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 12:03:07.761004 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:07.760988 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:07.761097 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:07.761085 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:08.261064126 +0000 UTC m=+92.281454218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:07.881183 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:07.881164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 12:03:07.887530 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:07.887512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmstd\"" Jul 22 12:03:07.891279 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:07.891268 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:03:07.891321 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:07.891309 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:08.391298601 +0000 UTC m=+92.411688682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : configmap "kube-rbac-proxy" not found Jul 22 12:03:08.267830 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.267803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:08.268164 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.267906 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:08.268164 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.267956 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:09.267944481 +0000 UTC m=+93.288334561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:08.469822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.469798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:08.469913 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.469900 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:03:08.469959 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.469942 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:09.469931597 +0000 UTC m=+93.490321677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : configmap "kube-rbac-proxy" not found Jul 22 12:03:08.553015 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.552991 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67"] Jul 22 12:03:08.555293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.555279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:08.557274 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.557255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 12:03:08.557372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.557313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:03:08.557535 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.557521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bkx5l\"" Jul 22 12:03:08.557608 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.557537 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 12:03:08.565354 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.565326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67"] Jul 22 12:03:08.671020 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.670992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:08.671122 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.671062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ft6g\" (UniqueName: \"kubernetes.io/projected/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-kube-api-access-9ft6g\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:08.765002 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.764984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x6nkf_cfb953d9-0662-48a1-a127-b54df59aa9bd/dns-node-resolver/0.log" Jul 22 12:03:08.772207 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.772187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:08.772270 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.772221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ft6g\" (UniqueName: \"kubernetes.io/projected/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-kube-api-access-9ft6g\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:08.772321 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.772308 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:03:08.772366 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:08.772356 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls podName:719bef7c-f185-4b10-b787-4bbd4ef1c2bf nodeName:}" failed. No retries permitted until 2026-07-22 12:03:09.272343273 +0000 UTC m=+93.292733356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5rc67" (UID: "719bef7c-f185-4b10-b787-4bbd4ef1c2bf") : secret "samples-operator-tls" not found Jul 22 12:03:08.781135 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:08.781110 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ft6g\" (UniqueName: \"kubernetes.io/projected/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-kube-api-access-9ft6g\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:09.275697 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.275668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:09.275963 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.275709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:09.275963 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.275811 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:09.275963 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.275870 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:11.275858301 +0000 UTC m=+95.296248384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:09.275963 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.275811 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:03:09.275963 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.275941 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls podName:719bef7c-f185-4b10-b787-4bbd4ef1c2bf nodeName:}" failed. No retries permitted until 2026-07-22 12:03:10.275929942 +0000 UTC m=+94.296320026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5rc67" (UID: "719bef7c-f185-4b10-b787-4bbd4ef1c2bf") : secret "samples-operator-tls" not found Jul 22 12:03:09.477249 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.477227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:09.477339 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.477280 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:03:09.477339 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:09.477323 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:11.477312604 +0000 UTC m=+95.497702684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : configmap "kube-rbac-proxy" not found Jul 22 12:03:09.534025 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.533981 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw"] Jul 22 12:03:09.536495 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.536480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" Jul 22 12:03:09.538736 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.538716 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:03:09.539496 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.539477 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2vvz9\"" Jul 22 12:03:09.539583 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.539497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 12:03:09.547467 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.547450 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw"] Jul 22 12:03:09.578033 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.578011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t9pv\" (UniqueName: \"kubernetes.io/projected/c65d5881-904b-4341-995d-9889b0e8f294-kube-api-access-8t9pv\") pod \"volume-data-source-validator-78cf4c6f6-7pqcw\" (UID: \"c65d5881-904b-4341-995d-9889b0e8f294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" Jul 22 12:03:09.678981 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.678960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t9pv\" (UniqueName: \"kubernetes.io/projected/c65d5881-904b-4341-995d-9889b0e8f294-kube-api-access-8t9pv\") pod \"volume-data-source-validator-78cf4c6f6-7pqcw\" (UID: \"c65d5881-904b-4341-995d-9889b0e8f294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" Jul 22 12:03:09.689032 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.689006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t9pv\" (UniqueName: \"kubernetes.io/projected/c65d5881-904b-4341-995d-9889b0e8f294-kube-api-access-8t9pv\") pod \"volume-data-source-validator-78cf4c6f6-7pqcw\" (UID: \"c65d5881-904b-4341-995d-9889b0e8f294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" Jul 22 12:03:09.764285 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.764265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlhgv_c55b3005-70cf-49ef-b15f-b890edbd8ccc/node-ca/0.log" Jul 22 12:03:09.845010 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.844958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" Jul 22 12:03:09.960407 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:09.960309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw"] Jul 22 12:03:09.963639 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:09.963614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65d5881_904b_4341_995d_9889b0e8f294.slice/crio-3d2e9ab13c574e604b264b82d5d855a2a67871886b726143bbb4d5487512b1c5 WatchSource:0}: Error finding container 3d2e9ab13c574e604b264b82d5d855a2a67871886b726143bbb4d5487512b1c5: Status 404 returned error can't find the container with id 3d2e9ab13c574e604b264b82d5d855a2a67871886b726143bbb4d5487512b1c5 Jul 22 12:03:10.283145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.283121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:10.283444 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:10.283282 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:03:10.283444 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:10.283352 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls podName:719bef7c-f185-4b10-b787-4bbd4ef1c2bf nodeName:}" failed. No retries permitted until 2026-07-22 12:03:12.283336067 +0000 UTC m=+96.303726147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5rc67" (UID: "719bef7c-f185-4b10-b787-4bbd4ef1c2bf") : secret "samples-operator-tls" not found Jul 22 12:03:10.365584 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.365569 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6z4l_7ac0d182-1afb-48a2-8bf3-1be8486c5ea9/serve-healthcheck-canary/0.log" Jul 22 12:03:10.481325 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.481307 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-db6s7"] Jul 22 12:03:10.484867 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.484853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.487061 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.487029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 12:03:10.487148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.487032 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 12:03:10.487309 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.487295 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 12:03:10.487359 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.487321 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:03:10.488031 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.488013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5ljx6\"" Jul 22 12:03:10.491938 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.491918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 12:03:10.495818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.495798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-db6s7"] Jul 22 12:03:10.584604 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.584554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-config\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.584693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.584625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkbh\" (UniqueName: \"kubernetes.io/projected/9680bea8-62d6-4775-b51d-5424ab474589-kube-api-access-9rkbh\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.584693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.584674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9680bea8-62d6-4775-b51d-5424ab474589-serving-cert\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.584806 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.584716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-trusted-ca\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.685634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.685612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9680bea8-62d6-4775-b51d-5424ab474589-serving-cert\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.685740 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.685641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-trusted-ca\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.685845 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.685827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-config\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.685915 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.685897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkbh\" (UniqueName: \"kubernetes.io/projected/9680bea8-62d6-4775-b51d-5424ab474589-kube-api-access-9rkbh\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.686534 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.686505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-config\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.686612 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.686547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9680bea8-62d6-4775-b51d-5424ab474589-trusted-ca\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.688292 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.688271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9680bea8-62d6-4775-b51d-5424ab474589-serving-cert\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.696352 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.696330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkbh\" (UniqueName: \"kubernetes.io/projected/9680bea8-62d6-4775-b51d-5424ab474589-kube-api-access-9rkbh\") pod \"console-operator-565b7b569d-db6s7\" (UID: \"9680bea8-62d6-4775-b51d-5424ab474589\") " pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.794056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.794018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:10.906449 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.906417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" event={"ID":"c65d5881-904b-4341-995d-9889b0e8f294","Type":"ContainerStarted","Data":"3d2e9ab13c574e604b264b82d5d855a2a67871886b726143bbb4d5487512b1c5"} Jul 22 12:03:10.922847 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:10.922812 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-db6s7"] Jul 22 12:03:11.025339 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:11.025311 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9680bea8_62d6_4775_b51d_5424ab474589.slice/crio-33243667ca1f541c445bb354882b938665e9ad7d7ffc168554b2858953b92b0b WatchSource:0}: Error finding container 33243667ca1f541c445bb354882b938665e9ad7d7ffc168554b2858953b92b0b: Status 404 returned error can't find the container with id 33243667ca1f541c445bb354882b938665e9ad7d7ffc168554b2858953b92b0b Jul 22 12:03:11.290842 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:11.290814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:11.291131 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:11.290943 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:11.291131 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:11.290993 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:15.290976839 +0000 UTC m=+99.311366920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:11.492138 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:11.492087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:11.492223 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:11.492171 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:03:11.492223 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:11.492211 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:15.492201112 +0000 UTC m=+99.512591196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : configmap "kube-rbac-proxy" not found Jul 22 12:03:11.911146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:11.910563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" event={"ID":"c65d5881-904b-4341-995d-9889b0e8f294","Type":"ContainerStarted","Data":"643c0eba78d593e0a5f07507e5442fb57a55dd7ed1c0c0b918212d004c653be4"} Jul 22 12:03:11.912553 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:11.912524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" event={"ID":"9680bea8-62d6-4775-b51d-5424ab474589","Type":"ContainerStarted","Data":"33243667ca1f541c445bb354882b938665e9ad7d7ffc168554b2858953b92b0b"} Jul 22 12:03:11.931583 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:11.931544 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7pqcw" podStartSLOduration=1.829028847 podStartE2EDuration="2.931527211s" totalImagesPullingTime="1.102498364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:11.930812764 +0000 UTC m=+95.951202865" watchObservedRunningTime="2026-07-22 12:03:11.931527211 +0000 UTC m=+95.951917314" Jul 22 12:03:12.298966 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.298936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:12.299342 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:12.299062 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:03:12.299342 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:12.299121 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls podName:719bef7c-f185-4b10-b787-4bbd4ef1c2bf nodeName:}" failed. No retries permitted until 2026-07-22 12:03:16.299104502 +0000 UTC m=+100.319494586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5rc67" (UID: "719bef7c-f185-4b10-b787-4bbd4ef1c2bf") : secret "samples-operator-tls" not found Jul 22 12:03:12.480612 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.480576 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf"] Jul 22 12:03:12.483598 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.483577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.485670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.485646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 12:03:12.485898 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.485877 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 12:03:12.486480 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.486458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sqqcw\"" Jul 22 12:03:12.486574 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.486512 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:03:12.486626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.486568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 12:03:12.494163 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.494144 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf"] Jul 22 12:03:12.600567 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.600504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.600567 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.600562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r7xb\" (UniqueName: \"kubernetes.io/projected/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-kube-api-access-5r7xb\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.600741 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.600630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.701424 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.701397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.701538 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.701437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r7xb\" (UniqueName: \"kubernetes.io/projected/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-kube-api-access-5r7xb\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.701538 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.701483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.701934 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.701910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.703808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.703784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.710298 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.710274 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r7xb\" (UniqueName: \"kubernetes.io/projected/3b46a25a-4d8b-484b-ac34-f77f1d5a1c64-kube-api-access-5r7xb\") pod \"kube-storage-version-migrator-operator-7658d9b749-xw6lf\" (UID: \"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:12.793615 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:12.793582 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" Jul 22 12:03:13.311236 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.311213 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf"] Jul 22 12:03:13.314217 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:13.314191 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b46a25a_4d8b_484b_ac34_f77f1d5a1c64.slice/crio-45ce7203a3521dd0876b853954452490cc6322a07809429bea8bcf4e24632c86 WatchSource:0}: Error finding container 45ce7203a3521dd0876b853954452490cc6322a07809429bea8bcf4e24632c86: Status 404 returned error can't find the container with id 45ce7203a3521dd0876b853954452490cc6322a07809429bea8bcf4e24632c86 Jul 22 12:03:13.918303 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.918274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" event={"ID":"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64","Type":"ContainerStarted","Data":"45ce7203a3521dd0876b853954452490cc6322a07809429bea8bcf4e24632c86"} Jul 22 12:03:13.919631 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.919613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/0.log" Jul 22 12:03:13.919728 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.919650 2564 generic.go:356] "Generic (PLEG): container finished" podID="9680bea8-62d6-4775-b51d-5424ab474589" containerID="7199ef14e7dc7fb71a6eed4ba0465f9abeca3096b9eda60142022a0943f09719" exitCode=255 Jul 22 12:03:13.919728 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.919680 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" event={"ID":"9680bea8-62d6-4775-b51d-5424ab474589","Type":"ContainerDied","Data":"7199ef14e7dc7fb71a6eed4ba0465f9abeca3096b9eda60142022a0943f09719"} Jul 22 12:03:13.919880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:13.919867 2564 scope.go:117] "RemoveContainer" containerID="7199ef14e7dc7fb71a6eed4ba0465f9abeca3096b9eda60142022a0943f09719" Jul 22 12:03:14.924621 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.924599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:03:14.925021 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.925007 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/0.log" Jul 22 12:03:14.925124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.925058 2564 generic.go:356] "Generic (PLEG): container finished" podID="9680bea8-62d6-4775-b51d-5424ab474589" containerID="cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438" exitCode=255 Jul 22 12:03:14.925124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.925101 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" event={"ID":"9680bea8-62d6-4775-b51d-5424ab474589","Type":"ContainerDied","Data":"cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438"} Jul 22 12:03:14.925201 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.925160 2564 scope.go:117] "RemoveContainer" containerID="7199ef14e7dc7fb71a6eed4ba0465f9abeca3096b9eda60142022a0943f09719" Jul 22 12:03:14.925371 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:14.925355 2564 scope.go:117] "RemoveContainer" containerID="cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438" Jul 22 12:03:14.925533 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:14.925514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-db6s7_openshift-console-operator(9680bea8-62d6-4775-b51d-5424ab474589)\"" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" podUID="9680bea8-62d6-4775-b51d-5424ab474589" Jul 22 12:03:15.219313 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.219244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:03:15.219454 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.219351 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:03:15.219454 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.219413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls podName:f3deab09-41a9-4ad6-8742-fb23987876c4 nodeName:}" failed. No retries permitted until 2026-07-22 12:04:19.219393152 +0000 UTC m=+163.239783232 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls") pod "dns-default-lfz8n" (UID: "f3deab09-41a9-4ad6-8742-fb23987876c4") : secret "dns-default-metrics-tls" not found Jul 22 12:03:15.319865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.319823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:15.320025 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.319992 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:15.320106 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.320088 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:23.320066628 +0000 UTC m=+107.340456722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:15.521547 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.521478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:15.521642 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.521612 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:03:15.521693 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.521681 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:23.521660993 +0000 UTC m=+107.542051078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : configmap "kube-rbac-proxy" not found Jul 22 12:03:15.929049 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.929011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:03:15.929492 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.929425 2564 scope.go:117] "RemoveContainer" containerID="cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438" Jul 22 12:03:15.929620 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:15.929599 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-db6s7_openshift-console-operator(9680bea8-62d6-4775-b51d-5424ab474589)\"" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" podUID="9680bea8-62d6-4775-b51d-5424ab474589" Jul 22 12:03:15.930611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.930591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" event={"ID":"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64","Type":"ContainerStarted","Data":"ba7663e52782d69191d2e71f9aac86bd0058b63367dd739ed29a94c90138f95f"} Jul 22 12:03:15.966806 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:15.966731 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" podStartSLOduration=1.874801749 podStartE2EDuration="3.966713934s" totalImagesPullingTime="2.091912185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:15.965432018 +0000 UTC m=+99.985822123" watchObservedRunningTime="2026-07-22 12:03:15.966713934 +0000 UTC m=+99.987104038" Jul 22 12:03:16.326668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:16.326639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:16.326812 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:16.326784 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:03:16.326866 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:16.326849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls podName:719bef7c-f185-4b10-b787-4bbd4ef1c2bf nodeName:}" failed. No retries permitted until 2026-07-22 12:03:24.326833995 +0000 UTC m=+108.347224075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5rc67" (UID: "719bef7c-f185-4b10-b787-4bbd4ef1c2bf") : secret "samples-operator-tls" not found Jul 22 12:03:17.342192 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.342161 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z"] Jul 22 12:03:17.345316 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.345300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" Jul 22 12:03:17.347797 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.347779 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w7bvd\"" Jul 22 12:03:17.356471 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.356452 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z"] Jul 22 12:03:17.434717 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.434691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkp7\" (UniqueName: \"kubernetes.io/projected/7ef18792-7320-44a4-a1cd-9a0ebcee34b9-kube-api-access-5rkp7\") pod \"network-check-source-7bc5b6bf85-46s4z\" (UID: \"7ef18792-7320-44a4-a1cd-9a0ebcee34b9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" Jul 22 12:03:17.535110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.535082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkp7\" (UniqueName: \"kubernetes.io/projected/7ef18792-7320-44a4-a1cd-9a0ebcee34b9-kube-api-access-5rkp7\") pod \"network-check-source-7bc5b6bf85-46s4z\" (UID: \"7ef18792-7320-44a4-a1cd-9a0ebcee34b9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" Jul 22 12:03:17.544674 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.544646 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkp7\" (UniqueName: \"kubernetes.io/projected/7ef18792-7320-44a4-a1cd-9a0ebcee34b9-kube-api-access-5rkp7\") pod \"network-check-source-7bc5b6bf85-46s4z\" (UID: \"7ef18792-7320-44a4-a1cd-9a0ebcee34b9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" Jul 22 12:03:17.653291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.653218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" Jul 22 12:03:17.778614 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.778582 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z"] Jul 22 12:03:17.780936 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:17.780912 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef18792_7320_44a4_a1cd_9a0ebcee34b9.slice/crio-7d7ff9a79cf9b14ed154f71f162bdcb2241a057c4b6f1061eb44fbdba7f0d34b WatchSource:0}: Error finding container 7d7ff9a79cf9b14ed154f71f162bdcb2241a057c4b6f1061eb44fbdba7f0d34b: Status 404 returned error can't find the container with id 7d7ff9a79cf9b14ed154f71f162bdcb2241a057c4b6f1061eb44fbdba7f0d34b Jul 22 12:03:17.794362 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.794116 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:03:17.798807 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.798780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.800881 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.800854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 12:03:17.800995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.800978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 12:03:17.801093 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.801020 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t9ltr\"" Jul 22 12:03:17.801093 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.801079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 12:03:17.805751 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.805734 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 12:03:17.807693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.807676 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:03:17.937865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.937802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" event={"ID":"7ef18792-7320-44a4-a1cd-9a0ebcee34b9","Type":"ContainerStarted","Data":"330e6a55fabf164be38260813e155196709b2de2e24961855febc920ddb48560"} Jul 22 12:03:17.937865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.937847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" event={"ID":"7ef18792-7320-44a4-a1cd-9a0ebcee34b9","Type":"ContainerStarted","Data":"7d7ff9a79cf9b14ed154f71f162bdcb2241a057c4b6f1061eb44fbdba7f0d34b"} Jul 22 12:03:17.940305 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.940284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.940370 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.940322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.940370 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.940359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.940436 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.940386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.940436 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.940423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.942065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.941277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.942065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.941403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.942065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.941452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfm47\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:17.957941 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:17.957902 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46s4z" podStartSLOduration=0.957891486 podStartE2EDuration="957.891486ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:17.957207976 +0000 UTC m=+101.977598079" watchObservedRunningTime="2026-07-22 12:03:17.957891486 +0000 UTC m=+101.978281587" Jul 22 12:03:18.042118 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfm47\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042481 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042754 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042730 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.042756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.042848 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.042778 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:03:18.042848 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.042797 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfc8d8669-nhpdm: secret "image-registry-tls" not found Jul 22 12:03:18.042995 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.042863 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls podName:414e00fc-bede-405a-90af-64c98af666b9 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:18.542845134 +0000 UTC m=+102.563235214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls") pod "image-registry-cfc8d8669-nhpdm" (UID: "414e00fc-bede-405a-90af-64c98af666b9") : secret "image-registry-tls" not found Jul 22 12:03:18.043155 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.043133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.044565 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.044540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.044777 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.044761 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.050706 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.050686 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfm47\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.050788 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.050719 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.546398 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.546372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:18.546686 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.546462 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:03:18.546686 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.546482 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfc8d8669-nhpdm: secret "image-registry-tls" not found Jul 22 12:03:18.546686 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:18.546546 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls podName:414e00fc-bede-405a-90af-64c98af666b9 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:19.546528579 +0000 UTC m=+103.566918660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls") pod "image-registry-cfc8d8669-nhpdm" (UID: "414e00fc-bede-405a-90af-64c98af666b9") : secret "image-registry-tls" not found Jul 22 12:03:18.850314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:18.850257 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5czjs" Jul 22 12:03:19.124958 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.124893 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mzz6r"] Jul 22 12:03:19.144190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.144169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mzz6r"] Jul 22 12:03:19.144303 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.144248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.146955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.146933 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 12:03:19.146955 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.146950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mdbll\"" Jul 22 12:03:19.147145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.146985 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 12:03:19.147145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.147028 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 12:03:19.147307 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.147293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 12:03:19.251178 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.251154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drwr4\" (UniqueName: \"kubernetes.io/projected/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-kube-api-access-drwr4\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.251288 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.251187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-key\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.251288 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.251205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-cabundle\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.351593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.351568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drwr4\" (UniqueName: \"kubernetes.io/projected/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-kube-api-access-drwr4\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.351696 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.351602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-key\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.351696 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.351622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-cabundle\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.352185 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.352169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-cabundle\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.354356 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.354333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-signing-key\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.360647 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.360627 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drwr4\" (UniqueName: \"kubernetes.io/projected/3c5ef92d-7d18-4d81-bba6-0189e0f0356b-kube-api-access-drwr4\") pod \"service-ca-58598695f7-mzz6r\" (UID: \"3c5ef92d-7d18-4d81-bba6-0189e0f0356b\") " pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.452841 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.452774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mzz6r" Jul 22 12:03:19.553565 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.553540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:19.553874 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:19.553695 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:03:19.553874 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:19.553712 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfc8d8669-nhpdm: secret "image-registry-tls" not found Jul 22 12:03:19.553874 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:19.553765 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls podName:414e00fc-bede-405a-90af-64c98af666b9 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:21.553750837 +0000 UTC m=+105.574140921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls") pod "image-registry-cfc8d8669-nhpdm" (UID: "414e00fc-bede-405a-90af-64c98af666b9") : secret "image-registry-tls" not found Jul 22 12:03:19.581056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.580935 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mzz6r"] Jul 22 12:03:19.583296 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:19.583274 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5ef92d_7d18_4d81_bba6_0189e0f0356b.slice/crio-25036f842655daf6018888356cc6c34e64f1bdf9259ba249b0823c0a1628c014 WatchSource:0}: Error finding container 25036f842655daf6018888356cc6c34e64f1bdf9259ba249b0823c0a1628c014: Status 404 returned error can't find the container with id 25036f842655daf6018888356cc6c34e64f1bdf9259ba249b0823c0a1628c014 Jul 22 12:03:19.944839 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:19.944813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mzz6r" event={"ID":"3c5ef92d-7d18-4d81-bba6-0189e0f0356b","Type":"ContainerStarted","Data":"25036f842655daf6018888356cc6c34e64f1bdf9259ba249b0823c0a1628c014"} Jul 22 12:03:20.794856 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:20.794826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:20.795282 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:20.794880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:20.795282 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:20.795244 2564 scope.go:117] "RemoveContainer" containerID="cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438" Jul 22 12:03:20.795402 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:20.795383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-db6s7_openshift-console-operator(9680bea8-62d6-4775-b51d-5424ab474589)\"" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" podUID="9680bea8-62d6-4775-b51d-5424ab474589" Jul 22 12:03:21.568895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:21.568871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:21.569013 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:21.568991 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:03:21.569091 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:21.569015 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfc8d8669-nhpdm: secret "image-registry-tls" not found Jul 22 12:03:21.569091 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:21.569086 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls podName:414e00fc-bede-405a-90af-64c98af666b9 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:25.569068273 +0000 UTC m=+109.589458357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls") pod "image-registry-cfc8d8669-nhpdm" (UID: "414e00fc-bede-405a-90af-64c98af666b9") : secret "image-registry-tls" not found Jul 22 12:03:21.952293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:21.952260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mzz6r" event={"ID":"3c5ef92d-7d18-4d81-bba6-0189e0f0356b","Type":"ContainerStarted","Data":"9aaa752d945f485f16263803693ea633bec80973ea3a944c8d1cd444e0b49ab7"} Jul 22 12:03:21.976598 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:21.973906 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-mzz6r" podStartSLOduration=1.057944522 podStartE2EDuration="2.973886115s" totalImagesPullingTime="1.915941593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:21.972223652 +0000 UTC m=+105.992613756" watchObservedRunningTime="2026-07-22 12:03:21.973886115 +0000 UTC m=+105.994276218" Jul 22 12:03:23.383926 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:23.383891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:23.384391 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:23.384010 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:03:23.384391 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:23.384114 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls podName:c768555a-20ee-44fe-ada2-685e74ca4583 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:39.384093931 +0000 UTC m=+123.404484028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jrhjs" (UID: "c768555a-20ee-44fe-ada2-685e74ca4583") : secret "insights-runtime-extractor-tls" not found Jul 22 12:03:23.584932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:23.584908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:23.585336 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:23.585320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c768555a-20ee-44fe-ada2-685e74ca4583-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:24.391666 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:24.391633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:24.393856 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:24.393832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/719bef7c-f185-4b10-b787-4bbd4ef1c2bf-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5rc67\" (UID: \"719bef7c-f185-4b10-b787-4bbd4ef1c2bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:24.463997 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:24.463970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" Jul 22 12:03:24.594722 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:24.594701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67"] Jul 22 12:03:24.962696 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:24.962666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" event={"ID":"719bef7c-f185-4b10-b787-4bbd4ef1c2bf","Type":"ContainerStarted","Data":"b1cc68efa3f98417747bae6dbcdc91abb85dd2c7810d16ab2c394c0c4d096a7e"} Jul 22 12:03:25.599462 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:25.599431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:25.599919 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:25.599570 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:03:25.599919 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:25.599584 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfc8d8669-nhpdm: secret "image-registry-tls" not found Jul 22 12:03:25.599919 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:25.599645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls podName:414e00fc-bede-405a-90af-64c98af666b9 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:33.599626398 +0000 UTC m=+117.620016484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls") pod "image-registry-cfc8d8669-nhpdm" (UID: "414e00fc-bede-405a-90af-64c98af666b9") : secret "image-registry-tls" not found Jul 22 12:03:26.969946 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:26.969911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" event={"ID":"719bef7c-f185-4b10-b787-4bbd4ef1c2bf","Type":"ContainerStarted","Data":"ad6efc060b49c67f7cac15e0baa5adb94de3486932057b470eb44487b2c3e025"} Jul 22 12:03:26.970297 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:26.969976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" event={"ID":"719bef7c-f185-4b10-b787-4bbd4ef1c2bf","Type":"ContainerStarted","Data":"b10d351983d81ab5e90d5b0811b2872c345526f240828b5bafcae01816d25d21"} Jul 22 12:03:26.987786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:26.987742 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5rc67" podStartSLOduration=17.340684119 podStartE2EDuration="18.987727431s" totalImagesPullingTime="1.647043312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:26.987232127 +0000 UTC m=+111.007622230" watchObservedRunningTime="2026-07-22 12:03:26.987727431 +0000 UTC m=+111.008117534" Jul 22 12:03:33.657337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.657292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:33.659917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.659884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"image-registry-cfc8d8669-nhpdm\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:33.725382 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.725357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:33.857077 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.857030 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:03:33.859450 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:33.859425 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414e00fc_bede_405a_90af_64c98af666b9.slice/crio-ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c WatchSource:0}: Error finding container ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c: Status 404 returned error can't find the container with id ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c Jul 22 12:03:33.990988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.990958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" event={"ID":"414e00fc-bede-405a-90af-64c98af666b9","Type":"ContainerStarted","Data":"f4acf7224d0845ce2175ba5bcc9be7bde0408b3836035441cc4672ee7b684ddd"} Jul 22 12:03:33.991129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.991002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" event={"ID":"414e00fc-bede-405a-90af-64c98af666b9","Type":"ContainerStarted","Data":"ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c"} Jul 22 12:03:33.991129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:33.991089 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:34.013107 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:34.013021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" podStartSLOduration=17.013004156 podStartE2EDuration="17.013004156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:34.011787918 +0000 UTC m=+118.032178033" watchObservedRunningTime="2026-07-22 12:03:34.013004156 +0000 UTC m=+118.033394258" Jul 22 12:03:35.589597 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:35.589564 2564 scope.go:117] "RemoveContainer" containerID="cbf7ec9fd11dc63085f7e5eef7841a1f7f0cc189a823d3217ebb1badb6175438" Jul 22 12:03:35.998554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:35.998489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:03:35.998675 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:35.998579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" event={"ID":"9680bea8-62d6-4775-b51d-5424ab474589","Type":"ContainerStarted","Data":"3e88e32055876d00000f1a3f9b0d9a51131d98884a03c3dad89782402eaa9279"} Jul 22 12:03:35.998887 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:35.998867 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:36.010369 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:36.010345 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" Jul 22 12:03:36.038274 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:36.038232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-db6s7" podStartSLOduration=23.819449172 podStartE2EDuration="26.038216608s" totalImagesPullingTime="2.218767436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:36.018980528 +0000 UTC m=+120.039370630" watchObservedRunningTime="2026-07-22 12:03:36.038216608 +0000 UTC m=+120.058606709" Jul 22 12:03:39.399029 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:39.398985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:39.401424 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:39.401396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c768555a-20ee-44fe-ada2-685e74ca4583-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrhjs\" (UID: \"c768555a-20ee-44fe-ada2-685e74ca4583\") " pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:39.524429 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:39.524400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmstd\"" Jul 22 12:03:39.533137 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:39.533102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrhjs" Jul 22 12:03:39.682787 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:39.682699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrhjs"] Jul 22 12:03:39.686099 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:39.686068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc768555a_20ee_44fe_ada2_685e74ca4583.slice/crio-51a724629c95ce1b0a04810994042d0c3a2dba9fd3692e4cffa6d217687c8ff2 WatchSource:0}: Error finding container 51a724629c95ce1b0a04810994042d0c3a2dba9fd3692e4cffa6d217687c8ff2: Status 404 returned error can't find the container with id 51a724629c95ce1b0a04810994042d0c3a2dba9fd3692e4cffa6d217687c8ff2 Jul 22 12:03:40.011820 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:40.011726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhjs" event={"ID":"c768555a-20ee-44fe-ada2-685e74ca4583","Type":"ContainerStarted","Data":"51a724629c95ce1b0a04810994042d0c3a2dba9fd3692e4cffa6d217687c8ff2"} Jul 22 12:03:43.938029 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:43.937992 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:03:44.056166 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.056117 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-svsl7"] Jul 22 12:03:44.059331 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.059300 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr"] Jul 22 12:03:44.059469 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.059397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:03:44.061434 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.061413 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 12:03:44.061559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.061439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sktgz\"" Jul 22 12:03:44.061613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.061600 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 12:03:44.062606 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.062588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:44.064561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.064545 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 22 12:03:44.064684 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.064578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4hbqf\"" Jul 22 12:03:44.070335 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.070309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-svsl7"] Jul 22 12:03:44.086412 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.086370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr"] Jul 22 12:03:44.243635 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.243536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fhql\" (UniqueName: \"kubernetes.io/projected/ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d-kube-api-access-2fhql\") pod \"downloads-5bc67dcd46-svsl7\" (UID: \"ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d\") " pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:03:44.243785 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.243658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b71ace9c-ac17-4008-adc1-9867126de1d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jbzwr\" (UID: \"b71ace9c-ac17-4008-adc1-9867126de1d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:44.344675 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.344634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b71ace9c-ac17-4008-adc1-9867126de1d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jbzwr\" (UID: \"b71ace9c-ac17-4008-adc1-9867126de1d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:44.344870 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.344752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fhql\" (UniqueName: \"kubernetes.io/projected/ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d-kube-api-access-2fhql\") pod \"downloads-5bc67dcd46-svsl7\" (UID: \"ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d\") " pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:03:44.348268 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.348217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b71ace9c-ac17-4008-adc1-9867126de1d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jbzwr\" (UID: \"b71ace9c-ac17-4008-adc1-9867126de1d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:44.357224 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.357201 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fhql\" (UniqueName: \"kubernetes.io/projected/ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d-kube-api-access-2fhql\") pod \"downloads-5bc67dcd46-svsl7\" (UID: \"ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d\") " pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:03:44.371161 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.371109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:03:44.376942 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.376923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:44.519994 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.519968 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-svsl7"] Jul 22 12:03:44.524498 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:44.524465 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7ee3c4_4fef_4c3b_923c_3007b3dcb57d.slice/crio-63f7ad694c597b9e963d1508a70051152eb3e42f3585641fa5aa38d9f0ddbf12 WatchSource:0}: Error finding container 63f7ad694c597b9e963d1508a70051152eb3e42f3585641fa5aa38d9f0ddbf12: Status 404 returned error can't find the container with id 63f7ad694c597b9e963d1508a70051152eb3e42f3585641fa5aa38d9f0ddbf12 Jul 22 12:03:44.534109 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:44.534085 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr"] Jul 22 12:03:44.536537 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:44.536512 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71ace9c_ac17_4008_adc1_9867126de1d9.slice/crio-02b130965a973ecaa0ede40f9a9ca3656347f889c5a86afbfa6dcfcf282fa163 WatchSource:0}: Error finding container 02b130965a973ecaa0ede40f9a9ca3656347f889c5a86afbfa6dcfcf282fa163: Status 404 returned error can't find the container with id 02b130965a973ecaa0ede40f9a9ca3656347f889c5a86afbfa6dcfcf282fa163 Jul 22 12:03:45.032845 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.032804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" event={"ID":"b71ace9c-ac17-4008-adc1-9867126de1d9","Type":"ContainerStarted","Data":"02b130965a973ecaa0ede40f9a9ca3656347f889c5a86afbfa6dcfcf282fa163"} Jul 22 12:03:45.035060 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.035010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhjs" event={"ID":"c768555a-20ee-44fe-ada2-685e74ca4583","Type":"ContainerStarted","Data":"8cd27c4d86e2a55eed2721242f6f6fe8285e21ded72f2c6de3e20b27cf7aa321"} Jul 22 12:03:45.036210 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.036164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-svsl7" event={"ID":"ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d","Type":"ContainerStarted","Data":"63f7ad694c597b9e963d1508a70051152eb3e42f3585641fa5aa38d9f0ddbf12"} Jul 22 12:03:45.737991 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.737947 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:03:45.741273 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.741247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.743383 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.743355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 12:03:45.743529 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.743508 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 12:03:45.744318 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.744296 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 12:03:45.744420 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.744302 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 12:03:45.744420 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.744308 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 12:03:45.744781 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.744622 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mkjgx\"" Jul 22 12:03:45.753091 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.753035 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:03:45.859783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvzk\" (UniqueName: \"kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.859783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.859783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.860017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.860017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.860017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.859924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvzk\" (UniqueName: \"kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.960834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.960734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.961784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.961481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.961991 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.961926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.962113 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.962075 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.964490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.964445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.964613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.964589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:45.985155 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:45.985087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvzk\" (UniqueName: \"kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk\") pod \"console-77974c9f7f-bzdp2\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:46.047995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.045341 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" event={"ID":"b71ace9c-ac17-4008-adc1-9867126de1d9","Type":"ContainerStarted","Data":"001119c9ef31e00fb236429b7b79e43d0ca922425880f67509512e969edded3d"} Jul 22 12:03:46.047995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.046455 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:46.052937 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.052881 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" Jul 22 12:03:46.054506 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.054283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:03:46.073818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.072410 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jbzwr" podStartSLOduration=0.846623438 podStartE2EDuration="2.072390017s" totalImagesPullingTime="1.225766579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:46.071861229 +0000 UTC m=+130.092251330" watchObservedRunningTime="2026-07-22 12:03:46.072390017 +0000 UTC m=+130.092780100" Jul 22 12:03:46.264296 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.264232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:03:46.267258 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.267224 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99-metrics-certs\") pod \"network-metrics-daemon-2n65z\" (UID: \"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99\") " pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:03:46.423003 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.422871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4n945\"" Jul 22 12:03:46.431136 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:46.431086 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2n65z" Jul 22 12:03:48.406056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:48.406012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2n65z"] Jul 22 12:03:48.408449 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:48.408420 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828b6aeb_52cc_49ad_ad8c_dfea0e0d5a99.slice/crio-e08748b2b532634f5faa961cfd4684875433bdd636687f5960038225f4afeec1 WatchSource:0}: Error finding container e08748b2b532634f5faa961cfd4684875433bdd636687f5960038225f4afeec1: Status 404 returned error can't find the container with id e08748b2b532634f5faa961cfd4684875433bdd636687f5960038225f4afeec1 Jul 22 12:03:48.423353 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:48.423326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:03:48.427036 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:03:48.427012 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6616f0df_6b1b_4618_aec7_42e358fff899.slice/crio-6fc0aa133d9fde6641b2b927aa30fd1fb7eafa34ad8a3926ecabb96092664d9d WatchSource:0}: Error finding container 6fc0aa133d9fde6641b2b927aa30fd1fb7eafa34ad8a3926ecabb96092664d9d: Status 404 returned error can't find the container with id 6fc0aa133d9fde6641b2b927aa30fd1fb7eafa34ad8a3926ecabb96092664d9d Jul 22 12:03:49.058833 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:49.058788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhjs" event={"ID":"c768555a-20ee-44fe-ada2-685e74ca4583","Type":"ContainerStarted","Data":"60c0002b9789d4ff7d97babe5f8c96e141738660a8f24341b3739eb12ff12ea3"} Jul 22 12:03:49.061031 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:49.060997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2n65z" event={"ID":"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99","Type":"ContainerStarted","Data":"e08748b2b532634f5faa961cfd4684875433bdd636687f5960038225f4afeec1"} Jul 22 12:03:49.065672 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:49.063640 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77974c9f7f-bzdp2" event={"ID":"6616f0df-6b1b-4618-aec7-42e358fff899","Type":"ContainerStarted","Data":"6fc0aa133d9fde6641b2b927aa30fd1fb7eafa34ad8a3926ecabb96092664d9d"} Jul 22 12:03:50.072873 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:50.072833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2n65z" event={"ID":"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99","Type":"ContainerStarted","Data":"499afe2dfb05858e33be19b1dc1adda5c219ecb0d8a85a98fd8c3aff50e69c2c"} Jul 22 12:03:50.073288 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:50.072900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2n65z" event={"ID":"828b6aeb-52cc-49ad-ad8c-dfea0e0d5a99","Type":"ContainerStarted","Data":"e248fd3785d48f19987a5a9e48010c96d596e60461f183ce5e63ab47cf2f6515"} Jul 22 12:03:53.833626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.833514 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2n65z" podStartSLOduration=136.697718066 podStartE2EDuration="2m17.833490848s" totalImagesPullingTime="1.135772782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:50.093641692 +0000 UTC m=+134.114031809" watchObservedRunningTime="2026-07-22 12:03:53.833490848 +0000 UTC m=+137.853880934" Jul 22 12:03:53.835029 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.835007 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r"] Jul 22 12:03:53.838735 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.838714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:53.846479 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.845372 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 12:03:53.846479 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.845581 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 12:03:53.846479 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.846254 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 12:03:53.869328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.866277 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h2j8l\"" Jul 22 12:03:53.869328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.866647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 12:03:53.869328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.867797 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 12:03:53.874154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.874125 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r"] Jul 22 12:03:53.876942 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.876309 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nx5rb"] Jul 22 12:03:53.880887 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.880867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.883926 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.883905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 12:03:53.884152 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.884133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fbpwm\"" Jul 22 12:03:53.884237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.884137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 12:03:53.884465 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.884447 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.923959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f1da31-394f-477d-a8b0-69e978f90882-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-root\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-wtmp\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-sys\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rts74\" (UniqueName: \"kubernetes.io/projected/70f2ba60-d2c0-45ce-8858-78039c70b71e-kube-api-access-rts74\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-metrics-client-ca\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdvb\" (UniqueName: \"kubernetes.io/projected/27f1da31-394f-477d-a8b0-69e978f90882-kube-api-access-ptdvb\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:53.924663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.924408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-textfile\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:53.955509 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:53.952688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f1da31-394f-477d-a8b0-69e978f90882-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-root\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-wtmp\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-sys\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.025988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rts74\" (UniqueName: \"kubernetes.io/projected/70f2ba60-d2c0-45ce-8858-78039c70b71e-kube-api-access-rts74\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-metrics-client-ca\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdvb\" (UniqueName: \"kubernetes.io/projected/27f1da31-394f-477d-a8b0-69e978f90882-kube-api-access-ptdvb\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.026670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.026670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-textfile\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.026670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.026469 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-textfile\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.027330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f1da31-394f-477d-a8b0-69e978f90882-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.028182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-metrics-client-ca\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.028280 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.028345 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls podName:70f2ba60-d2c0-45ce-8858-78039c70b71e nodeName:}" failed. No retries permitted until 2026-07-22 12:03:54.528326214 +0000 UTC m=+138.548716297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls") pod "node-exporter-nx5rb" (UID: "70f2ba60-d2c0-45ce-8858-78039c70b71e") : secret "node-exporter-tls" not found Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.028667 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-wtmp\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.029181 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.028720 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-root\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.030267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.029807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.030267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.030114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70f2ba60-d2c0-45ce-8858-78039c70b71e-sys\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.030267 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.030192 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 12:03:54.030267 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.030245 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls podName:27f1da31-394f-477d-a8b0-69e978f90882 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:54.530227856 +0000 UTC m=+138.550617945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-2kw2r" (UID: "27f1da31-394f-477d-a8b0-69e978f90882") : secret "openshift-state-metrics-tls" not found Jul 22 12:03:54.032973 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.032935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.034324 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.034281 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.059628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.054765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdvb\" (UniqueName: \"kubernetes.io/projected/27f1da31-394f-477d-a8b0-69e978f90882-kube-api-access-ptdvb\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.059628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.058552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rts74\" (UniqueName: \"kubernetes.io/projected/70f2ba60-d2c0-45ce-8858-78039c70b71e-kube-api-access-rts74\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.531915 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.531761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.531915 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.531837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:54.532356 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.531967 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 12:03:54.532356 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:54.532067 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls podName:27f1da31-394f-477d-a8b0-69e978f90882 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:55.53202429 +0000 UTC m=+139.552414374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-2kw2r" (UID: "27f1da31-394f-477d-a8b0-69e978f90882") : secret "openshift-state-metrics-tls" not found Jul 22 12:03:54.535822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.535627 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70f2ba60-d2c0-45ce-8858-78039c70b71e-node-exporter-tls\") pod \"node-exporter-nx5rb\" (UID: \"70f2ba60-d2c0-45ce-8858-78039c70b71e\") " pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.793894 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.793598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nx5rb" Jul 22 12:03:54.866269 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.864212 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:03:54.870327 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.870304 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.875978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.876204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.876411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.876598 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.876769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.876956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.877142 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4d27m\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.878321 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.878547 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 12:03:54.880102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.878739 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 12:03:54.893842 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.893752 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:03:54.934825 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.934825 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.934825 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.934825 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.934977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.935065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78wv\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935430 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.935112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935430 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.935239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935430 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.935273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:54.935430 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:54.935392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036252 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036252 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.036784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78wv\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.036997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037796 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.037767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037902 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.037866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.037902 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:55.037881 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 22 12:03:55.038008 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:55.037940 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls podName:fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:55.537922205 +0000 UTC m=+139.558312299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3") : secret "alertmanager-main-tls" not found Jul 22 12:03:55.038818 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.038799 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.042330 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.042302 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.043939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.043606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.043939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.043872 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.044437 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.044402 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.045387 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.045298 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.045489 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.045423 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.045675 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.045655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.047796 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.047554 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.057584 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.057193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78wv\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.542147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.542100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.542335 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.542220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:55.544822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.544798 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f1da31-394f-477d-a8b0-69e978f90882-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-2kw2r\" (UID: \"27f1da31-394f-477d-a8b0-69e978f90882\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:55.544938 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.544837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.681816 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.681783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" Jul 22 12:03:55.797666 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.797593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:03:55.979416 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.979379 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c645c6b95-cxhwl"] Jul 22 12:03:55.983324 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.983303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:55.988854 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.988682 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 12:03:55.988854 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.988717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 12:03:55.989057 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.988888 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 12:03:55.989291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.989272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 12:03:55.989706 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.989682 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xzf2b\"" Jul 22 12:03:55.989787 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.989737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2d19c39estca1\"" Jul 22 12:03:55.990559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:55.990021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 12:03:56.013893 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.013861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c645c6b95-cxhwl"] Jul 22 12:03:56.046211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046407 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9nfb\" (UniqueName: \"kubernetes.io/projected/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-kube-api-access-m9nfb\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046407 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046407 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-metrics-client-ca\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-grpc-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.046613 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.046579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.105129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.105034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrhjs" event={"ID":"c768555a-20ee-44fe-ada2-685e74ca4583","Type":"ContainerStarted","Data":"b3662c3ea13c5666926916e36f93c9f62b5ff0ea22226f5df98e00d2609480c8"} Jul 22 12:03:56.106668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.106641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77974c9f7f-bzdp2" event={"ID":"6616f0df-6b1b-4618-aec7-42e358fff899","Type":"ContainerStarted","Data":"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a"} Jul 22 12:03:56.107788 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.107766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nx5rb" event={"ID":"70f2ba60-d2c0-45ce-8858-78039c70b71e","Type":"ContainerStarted","Data":"5aa7ccb30416e9fb5d9666eee7a16fb5c4f41288f4975745a301870180f3e109"} Jul 22 12:03:56.141918 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.141869 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jrhjs" podStartSLOduration=34.810306411 podStartE2EDuration="50.141854612s" totalImagesPullingTime="15.331548201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:03:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:56.137458812 +0000 UTC m=+140.157848914" watchObservedRunningTime="2026-07-22 12:03:56.141854612 +0000 UTC m=+140.162244713" Jul 22 12:03:56.147951 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.147926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9nfb\" (UniqueName: \"kubernetes.io/projected/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-kube-api-access-m9nfb\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.147970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-metrics-client-ca\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-grpc-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.148111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.148324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.149592 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.149551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-metrics-client-ca\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.151301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.151301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.151719 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-grpc-tls\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.151812 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151714 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.151878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.152032 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.151986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.166821 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.166798 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9nfb\" (UniqueName: \"kubernetes.io/projected/1e4e0a78-7b96-4809-8bd8-b8fc5705ad47-kube-api-access-m9nfb\") pod \"thanos-querier-7c645c6b95-cxhwl\" (UID: \"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47\") " pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:56.293603 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:56.293558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:03:58.286102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.286031 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77974c9f7f-bzdp2" podStartSLOduration=6.534447549 podStartE2EDuration="13.286015148s" totalImagesPullingTime="6.751567599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:03:56.16795149 +0000 UTC m=+140.188341595" watchObservedRunningTime="2026-07-22 12:03:58.286015148 +0000 UTC m=+142.306405250" Jul 22 12:03:58.286555 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.286222 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79fc7b9889-9zq6r"] Jul 22 12:03:58.289439 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.289419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.292191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.292166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 12:03:58.293017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.292809 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 12:03:58.293017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.292895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 12:03:58.293017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.292903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94v6m\"" Jul 22 12:03:58.293017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.292968 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-n61gdvupnjd9\"" Jul 22 12:03:58.293255 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.293187 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 12:03:58.302016 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.301998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79fc7b9889-9zq6r"] Jul 22 12:03:58.367378 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367544 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-client-certs\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367544 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-tls\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqxn\" (UniqueName: \"kubernetes.io/projected/389f942a-7002-4efb-a3b4-1130666dea57-kube-api-access-gvqxn\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389f942a-7002-4efb-a3b4-1130666dea57-audit-log\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-metrics-server-audit-profiles\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.367771 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.367708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-client-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468489 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-client-certs\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468617 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-tls\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468683 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqxn\" (UniqueName: \"kubernetes.io/projected/389f942a-7002-4efb-a3b4-1130666dea57-kube-api-access-gvqxn\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468741 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389f942a-7002-4efb-a3b4-1130666dea57-audit-log\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468784 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-metrics-server-audit-profiles\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468978 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-client-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.468978 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.468865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.469157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.469133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389f942a-7002-4efb-a3b4-1130666dea57-audit-log\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.469581 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.469558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.469866 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.469816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389f942a-7002-4efb-a3b4-1130666dea57-metrics-server-audit-profiles\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.471340 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.471301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-tls\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.471743 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.471700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-client-ca-bundle\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.471871 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.471811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389f942a-7002-4efb-a3b4-1130666dea57-secret-metrics-server-client-certs\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.478050 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.478002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqxn\" (UniqueName: \"kubernetes.io/projected/389f942a-7002-4efb-a3b4-1130666dea57-kube-api-access-gvqxn\") pod \"metrics-server-79fc7b9889-9zq6r\" (UID: \"389f942a-7002-4efb-a3b4-1130666dea57\") " pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.547110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.547036 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7"] Jul 22 12:03:58.551182 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.551163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:58.553867 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.553846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 12:03:58.554141 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.554117 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7t762\"" Jul 22 12:03:58.562988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.562965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7"] Jul 22 12:03:58.569869 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.569844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-kube-api-access-489ts\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:58.569956 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.569889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:58.601925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.601905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:03:58.671285 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.671260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-kube-api-access-489ts\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:58.671395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.671296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:58.671461 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:58.671431 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 12:03:58.671508 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:03:58.671472 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert podName:128b0d08-a38f-4ce5-8a96-41b4b69ca7c5 nodeName:}" failed. No retries permitted until 2026-07-22 12:03:59.171460695 +0000 UTC m=+143.191850775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-cfcs7" (UID: "128b0d08-a38f-4ce5-8a96-41b4b69ca7c5") : secret "monitoring-plugin-cert" not found Jul 22 12:03:58.681548 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:58.681524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-kube-api-access-489ts\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:59.020314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.020224 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b9df46f68-wfncf"] Jul 22 12:03:59.023876 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.023856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.026226 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026199 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 12:03:59.026526 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026508 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 12:03:59.026971 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 12:03:59.026971 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 12:03:59.026971 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026886 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 12:03:59.026971 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.026886 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qmwh7\"" Jul 22 12:03:59.033875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.033858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 12:03:59.044704 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.044662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9df46f68-wfncf"] Jul 22 12:03:59.075262 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-federate-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswdz\" (UniqueName: \"kubernetes.io/projected/1abd22cd-9755-4b09-8596-ea29270428cd-kube-api-access-wswdz\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-metrics-client-ca\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075561 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.075681 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.075598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-serving-certs-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176533 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-metrics-client-ca\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176678 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176678 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:59.176775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-serving-certs-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-federate-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.176878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswdz\" (UniqueName: \"kubernetes.io/projected/1abd22cd-9755-4b09-8596-ea29270428cd-kube-api-access-wswdz\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.177022 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.176881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.177428 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.177368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-metrics-client-ca\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.177859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.177811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.177973 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.177893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1abd22cd-9755-4b09-8596-ea29270428cd-serving-certs-ca-bundle\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.179714 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.179687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.179860 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.179835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-federate-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.179860 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.179851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-secret-telemeter-client\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.180022 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.179855 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/128b0d08-a38f-4ce5-8a96-41b4b69ca7c5-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cfcs7\" (UID: \"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:03:59.180095 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.180080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1abd22cd-9755-4b09-8596-ea29270428cd-telemeter-client-tls\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.187530 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.187501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswdz\" (UniqueName: \"kubernetes.io/projected/1abd22cd-9755-4b09-8596-ea29270428cd-kube-api-access-wswdz\") pod \"telemeter-client-5b9df46f68-wfncf\" (UID: \"1abd22cd-9755-4b09-8596-ea29270428cd\") " pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.335546 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.335519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" Jul 22 12:03:59.462204 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:03:59.462176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:04:01.542834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.542799 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:04:01.582377 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.582350 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:01.669387 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.669354 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:01.669537 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.669487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.682312 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.682291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 12:04:01.703072 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703179 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703241 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703241 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703346 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703346 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.703346 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.703329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhgnt\" (UniqueName: \"kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.803917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.803824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgnt\" (UniqueName: \"kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.803917 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.803917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.803940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.803984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804743 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804852 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.804988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.804982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.806698 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.806676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.807088 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.807065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.815027 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.815007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhgnt\" (UniqueName: \"kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt\") pod \"console-5dc7b5f548-dhxq4\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:01.980401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:01.980358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:02.437517 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.437490 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79fc7b9889-9zq6r"] Jul 22 12:04:02.492261 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.492192 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9df46f68-wfncf"] Jul 22 12:04:02.557791 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.557748 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389f942a_7002_4efb_a3b4_1130666dea57.slice/crio-d367a8cb561e375b8b4fbed4e23a5a58468de4806d1b6cae3478a0cc28a8d427 WatchSource:0}: Error finding container d367a8cb561e375b8b4fbed4e23a5a58468de4806d1b6cae3478a0cc28a8d427: Status 404 returned error can't find the container with id d367a8cb561e375b8b4fbed4e23a5a58468de4806d1b6cae3478a0cc28a8d427 Jul 22 12:04:02.558254 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.558231 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abd22cd_9755_4b09_8596_ea29270428cd.slice/crio-014ee2085c053c032eb8ea3dee677cb9aeb96845feeaf587c2989bfba9bc6681 WatchSource:0}: Error finding container 014ee2085c053c032eb8ea3dee677cb9aeb96845feeaf587c2989bfba9bc6681: Status 404 returned error can't find the container with id 014ee2085c053c032eb8ea3dee677cb9aeb96845feeaf587c2989bfba9bc6681 Jul 22 12:04:02.674616 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.673974 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r"] Jul 22 12:04:02.676656 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.676589 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f1da31_394f_477d_a8b0_69e978f90882.slice/crio-41ab8cdf2be6c6e84e03e19e641f36758c412caaffac15d09747204bfe0b7bdc WatchSource:0}: Error finding container 41ab8cdf2be6c6e84e03e19e641f36758c412caaffac15d09747204bfe0b7bdc: Status 404 returned error can't find the container with id 41ab8cdf2be6c6e84e03e19e641f36758c412caaffac15d09747204bfe0b7bdc Jul 22 12:04:02.689675 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.689648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c645c6b95-cxhwl"] Jul 22 12:04:02.692414 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.692392 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4e0a78_7b96_4809_8bd8_b8fc5705ad47.slice/crio-eb358ddcc117736f9885ce8c96c42654393420180d06b7f1377a63a682a42f6f WatchSource:0}: Error finding container eb358ddcc117736f9885ce8c96c42654393420180d06b7f1377a63a682a42f6f: Status 404 returned error can't find the container with id eb358ddcc117736f9885ce8c96c42654393420180d06b7f1377a63a682a42f6f Jul 22 12:04:02.697747 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.697727 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:04:02.702206 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.702186 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5b1155_7b73_4d8c_8c7b_6b9f0a5334d3.slice/crio-2b71dfb54bda45064d878d82f1adbe1a9a1f86020c59fb19660a382c02e3b7a4 WatchSource:0}: Error finding container 2b71dfb54bda45064d878d82f1adbe1a9a1f86020c59fb19660a382c02e3b7a4: Status 404 returned error can't find the container with id 2b71dfb54bda45064d878d82f1adbe1a9a1f86020c59fb19660a382c02e3b7a4 Jul 22 12:04:02.723465 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.723367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:02.725848 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.725823 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a WatchSource:0}: Error finding container 5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a: Status 404 returned error can't find the container with id 5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a Jul 22 12:04:02.754835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:02.754810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7"] Jul 22 12:04:02.760181 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:02.760159 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128b0d08_a38f_4ce5_8a96_41b4b69ca7c5.slice/crio-2675f066b69b8edbfa9c9edfe79fd1d83f4c610ccc4446b205c1f894206bada0 WatchSource:0}: Error finding container 2675f066b69b8edbfa9c9edfe79fd1d83f4c610ccc4446b205c1f894206bada0: Status 404 returned error can't find the container with id 2675f066b69b8edbfa9c9edfe79fd1d83f4c610ccc4446b205c1f894206bada0 Jul 22 12:04:03.147251 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.147053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc7b5f548-dhxq4" event={"ID":"68f9b9f6-481a-4583-bc73-fd31a412d600","Type":"ContainerStarted","Data":"6c4e1599bdd91a762291dd2793a40bf43326d1cce00d6bf9a0d2a51167abdaf6"} Jul 22 12:04:03.147251 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.147119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc7b5f548-dhxq4" event={"ID":"68f9b9f6-481a-4583-bc73-fd31a412d600","Type":"ContainerStarted","Data":"5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a"} Jul 22 12:04:03.150902 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.150830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" event={"ID":"389f942a-7002-4efb-a3b4-1130666dea57","Type":"ContainerStarted","Data":"d367a8cb561e375b8b4fbed4e23a5a58468de4806d1b6cae3478a0cc28a8d427"} Jul 22 12:04:03.173171 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.169771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" event={"ID":"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5","Type":"ContainerStarted","Data":"2675f066b69b8edbfa9c9edfe79fd1d83f4c610ccc4446b205c1f894206bada0"} Jul 22 12:04:03.173171 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.172423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"2b71dfb54bda45064d878d82f1adbe1a9a1f86020c59fb19660a382c02e3b7a4"} Jul 22 12:04:03.179419 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.179094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"eb358ddcc117736f9885ce8c96c42654393420180d06b7f1377a63a682a42f6f"} Jul 22 12:04:03.183059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.182996 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dc7b5f548-dhxq4" podStartSLOduration=2.182978726 podStartE2EDuration="2.182978726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:03.180234587 +0000 UTC m=+147.200624689" watchObservedRunningTime="2026-07-22 12:04:03.182978726 +0000 UTC m=+147.203368828" Jul 22 12:04:03.183606 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.183586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" event={"ID":"1abd22cd-9755-4b09-8596-ea29270428cd","Type":"ContainerStarted","Data":"014ee2085c053c032eb8ea3dee677cb9aeb96845feeaf587c2989bfba9bc6681"} Jul 22 12:04:03.190342 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.190307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-svsl7" event={"ID":"ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d","Type":"ContainerStarted","Data":"5ec913ae6802e26148b0819e588cbb645932fd5f3f0a43ecb05ba29cc299426a"} Jul 22 12:04:03.192648 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.192632 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:04:03.194793 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.194780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-svsl7" Jul 22 12:04:03.197726 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.197689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" event={"ID":"27f1da31-394f-477d-a8b0-69e978f90882","Type":"ContainerStarted","Data":"a3b8a2ac8767babbd89c90cf46f07e28d67d466477d489a6a0a25c712d5acf0f"} Jul 22 12:04:03.197957 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.197906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" event={"ID":"27f1da31-394f-477d-a8b0-69e978f90882","Type":"ContainerStarted","Data":"538f69753fe84d7f948ff146a9640155e043af9ff29cb1336549f2409fa8b341"} Jul 22 12:04:03.198835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.198815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" event={"ID":"27f1da31-394f-477d-a8b0-69e978f90882","Type":"ContainerStarted","Data":"41ab8cdf2be6c6e84e03e19e641f36758c412caaffac15d09747204bfe0b7bdc"} Jul 22 12:04:03.217284 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:03.217236 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-svsl7" podStartSLOduration=1.104959119 podStartE2EDuration="19.217217302s" totalImagesPullingTime="18.112258183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:03.214756667 +0000 UTC m=+147.235146771" watchObservedRunningTime="2026-07-22 12:04:03.217217302 +0000 UTC m=+147.237607407" Jul 22 12:04:04.222950 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:04.222511 2564 generic.go:356] "Generic (PLEG): container finished" podID="70f2ba60-d2c0-45ce-8858-78039c70b71e" containerID="390dd9473c0599dfe516dc02bf735c1456c67f553eadbc33c42beda5208b8a63" exitCode=0 Jul 22 12:04:04.222950 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:04.222635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nx5rb" event={"ID":"70f2ba60-d2c0-45ce-8858-78039c70b71e","Type":"ContainerDied","Data":"390dd9473c0599dfe516dc02bf735c1456c67f553eadbc33c42beda5208b8a63"} Jul 22 12:04:06.054810 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:06.054781 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:04:08.964253 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:08.964168 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" podUID="414e00fc-bede-405a-90af-64c98af666b9" containerName="registry" containerID="cri-o://f4acf7224d0845ce2175ba5bcc9be7bde0408b3836035441cc4672ee7b684ddd" gracePeriod=30 Jul 22 12:04:09.256114 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.256072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nx5rb" event={"ID":"70f2ba60-d2c0-45ce-8858-78039c70b71e","Type":"ContainerStarted","Data":"77df1f5e990412549517fa2dbb3afd92259803069695e4951a6d8a4e43267191"} Jul 22 12:04:09.256267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.256174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nx5rb" event={"ID":"70f2ba60-d2c0-45ce-8858-78039c70b71e","Type":"ContainerStarted","Data":"77f9adac35c67d77f8204a482414015a946afc1299689e3a4af17b33fafb558a"} Jul 22 12:04:09.257889 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.257855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" event={"ID":"389f942a-7002-4efb-a3b4-1130666dea57","Type":"ContainerStarted","Data":"72d0e0c9362f410e71efcdc8b470a7482296be7b6742ce3f1afe35c15153e017"} Jul 22 12:04:09.260096 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.260073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" event={"ID":"128b0d08-a38f-4ce5-8a96-41b4b69ca7c5","Type":"ContainerStarted","Data":"80e874dc6f2e4977c01da57ed46c020e75065dc394674f1e0462753b03ec33b1"} Jul 22 12:04:09.260307 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.260289 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:04:09.262255 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.262228 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="4f540f18f47a412a8c7f9f8afe0b43b5e07a76fa136dad93bc92d5b853b1c6e2" exitCode=0 Jul 22 12:04:09.262410 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.262313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"4f540f18f47a412a8c7f9f8afe0b43b5e07a76fa136dad93bc92d5b853b1c6e2"} Jul 22 12:04:09.264216 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.264144 2564 generic.go:356] "Generic (PLEG): container finished" podID="414e00fc-bede-405a-90af-64c98af666b9" containerID="f4acf7224d0845ce2175ba5bcc9be7bde0408b3836035441cc4672ee7b684ddd" exitCode=0 Jul 22 12:04:09.264301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.264227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" event={"ID":"414e00fc-bede-405a-90af-64c98af666b9","Type":"ContainerDied","Data":"f4acf7224d0845ce2175ba5bcc9be7bde0408b3836035441cc4672ee7b684ddd"} Jul 22 12:04:09.264301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.264261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" event={"ID":"414e00fc-bede-405a-90af-64c98af666b9","Type":"ContainerDied","Data":"ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c"} Jul 22 12:04:09.264301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.264281 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee6b73f9abf32aaeb3d803dcca5b116659877b84babc48822004402a5839bd7c" Jul 22 12:04:09.266779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.266759 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" Jul 22 12:04:09.266976 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.266952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"157f601a8632f7a8b96fb01ed2733721a65834837eab4f549f9f548cd9363fd2"} Jul 22 12:04:09.267125 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.267002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"7e217728767f505adfe5f7e7d217f3aaba9419767c65f218ff571f359f5f80c8"} Jul 22 12:04:09.267125 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.267035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"849305ce89a50d14e011a85f0ccc894d9b59c1910de7549b586d29250a97a28b"} Jul 22 12:04:09.269515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.269326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" event={"ID":"1abd22cd-9755-4b09-8596-ea29270428cd","Type":"ContainerStarted","Data":"dbc3af32a791c159f1c6b35f2b032c0bfb7fcb06380343d8fa2fc599fb4db9f4"} Jul 22 12:04:09.269515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.269400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" event={"ID":"1abd22cd-9755-4b09-8596-ea29270428cd","Type":"ContainerStarted","Data":"bb771bc3c56837b60e0a87b6d34b91d093c514c6769bd9a893a5a42d1ae95fc0"} Jul 22 12:04:09.269515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.269433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" event={"ID":"1abd22cd-9755-4b09-8596-ea29270428cd","Type":"ContainerStarted","Data":"a723a671f8ebe819cd9045636ee6ad68dd8686ada7891b54933d79502a568a2e"} Jul 22 12:04:09.271703 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.271684 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:04:09.271788 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.271736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" event={"ID":"27f1da31-394f-477d-a8b0-69e978f90882","Type":"ContainerStarted","Data":"8e3a19b64c0f05af5dbe2bf419fd7bfa7374fb5e560cc662b872090c9c9cc2f8"} Jul 22 12:04:09.281088 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.281021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nx5rb" podStartSLOduration=8.267258529 podStartE2EDuration="16.281008272s" totalImagesPullingTime="7.899126707s" totalInitContainerRuntime="114.623036ms" isStatefulPod=true podCreationTimestamp="2026-07-22 12:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:09.27987565 +0000 UTC m=+153.300265763" watchObservedRunningTime="2026-07-22 12:04:09.281008272 +0000 UTC m=+153.301398373" Jul 22 12:04:09.301485 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.301444 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cfcs7" podStartSLOduration=5.769073056 podStartE2EDuration="11.301432655s" totalImagesPullingTime="5.532359599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:09.30011983 +0000 UTC m=+153.320509943" watchObservedRunningTime="2026-07-22 12:04:09.301432655 +0000 UTC m=+153.321822756" Jul 22 12:04:09.326632 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.323694 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-2kw2r" podStartSLOduration=10.831365808 podStartE2EDuration="16.323677064s" totalImagesPullingTime="5.492311256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:09.322925834 +0000 UTC m=+153.343315938" watchObservedRunningTime="2026-07-22 12:04:09.323677064 +0000 UTC m=+153.344067167" Jul 22 12:04:09.348257 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.348217 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" podStartSLOduration=5.634031818 podStartE2EDuration="11.348205136s" totalImagesPullingTime="5.714173318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:09.346717546 +0000 UTC m=+153.367107650" watchObservedRunningTime="2026-07-22 12:04:09.348205136 +0000 UTC m=+153.368595308" Jul 22 12:04:09.389576 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389547 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389701 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389602 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389701 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389646 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389701 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389678 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfm47\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389737 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389761 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389823 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.389859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.389846 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token\") pod \"414e00fc-bede-405a-90af-64c98af666b9\" (UID: \"414e00fc-bede-405a-90af-64c98af666b9\") " Jul 22 12:04:09.390082 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.390031 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:09.391299 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.390218 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:09.391299 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.391006 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-registry-certificates\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.391299 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.391027 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/414e00fc-bede-405a-90af-64c98af666b9-trusted-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.392629 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.392596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:04:09.393078 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.393021 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47" (OuterVolumeSpecName: "kube-api-access-bfm47") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "kube-api-access-bfm47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:04:09.396401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.396369 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:04:09.397211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.397178 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:09.398469 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.398448 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:09.401421 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.401391 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "414e00fc-bede-405a-90af-64c98af666b9" (UID: "414e00fc-bede-405a-90af-64c98af666b9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491904 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-registry-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491926 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-installation-pull-secrets\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491936 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-bound-sa-token\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491945 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/414e00fc-bede-405a-90af-64c98af666b9-image-registry-private-configuration\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491954 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/414e00fc-bede-405a-90af-64c98af666b9-ca-trust-extracted\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.491962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.491965 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfm47\" (UniqueName: \"kubernetes.io/projected/414e00fc-bede-405a-90af-64c98af666b9-kube-api-access-bfm47\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:09.494340 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:09.494291 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b9df46f68-wfncf" podStartSLOduration=5.780375741 podStartE2EDuration="11.494239524s" totalImagesPullingTime="5.713863783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:09.492737943 +0000 UTC m=+153.513128045" watchObservedRunningTime="2026-07-22 12:04:09.494239524 +0000 UTC m=+153.514629627" Jul 22 12:04:10.248953 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.248916 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:10.287062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.281813 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfc8d8669-nhpdm" Jul 22 12:04:10.287062 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.287025 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:04:10.287542 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.287523 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414e00fc-bede-405a-90af-64c98af666b9" containerName="registry" Jul 22 12:04:10.287675 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.287664 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="414e00fc-bede-405a-90af-64c98af666b9" containerName="registry" Jul 22 12:04:10.287861 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.287848 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="414e00fc-bede-405a-90af-64c98af666b9" containerName="registry" Jul 22 12:04:10.311111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.311009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:04:10.311227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.311123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.327402 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.327377 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:04:10.333134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.333112 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cfc8d8669-nhpdm"] Jul 22 12:04:10.398406 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.398371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.398663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.398632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.398663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.398671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xblx\" (UniqueName: \"kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.398663 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.398704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.399141 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.398748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.399141 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.399009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.399249 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.399212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.500911 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.500839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.500911 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.500904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.501147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.500928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xblx\" (UniqueName: \"kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.501147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.500957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.501147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.500982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.501147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.501017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.501147 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.501084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.502339 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.501818 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.502339 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.501948 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.502339 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.502297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.503061 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.503001 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.503998 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.503956 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.504816 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.504748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.512495 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.512458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xblx\" (UniqueName: \"kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx\") pod \"console-7b8cf6d8b9-vdpnj\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:10.596877 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.596843 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414e00fc-bede-405a-90af-64c98af666b9" path="/var/lib/kubelet/pods/414e00fc-bede-405a-90af-64c98af666b9/volumes" Jul 22 12:04:10.625856 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:10.625832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:11.048802 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:11.048775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:04:11.056876 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:11.056842 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7088c0ba_4ce2_4a18_8cf0_8f3a0421ed96.slice/crio-8150f6e4bdc2fd6ad12c5edf3688a0049f2807680f372e4a6057f23f28a8692d WatchSource:0}: Error finding container 8150f6e4bdc2fd6ad12c5edf3688a0049f2807680f372e4a6057f23f28a8692d: Status 404 returned error can't find the container with id 8150f6e4bdc2fd6ad12c5edf3688a0049f2807680f372e4a6057f23f28a8692d Jul 22 12:04:11.286958 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:11.286920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8cf6d8b9-vdpnj" event={"ID":"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96","Type":"ContainerStarted","Data":"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa"} Jul 22 12:04:11.287418 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:11.286971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8cf6d8b9-vdpnj" event={"ID":"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96","Type":"ContainerStarted","Data":"8150f6e4bdc2fd6ad12c5edf3688a0049f2807680f372e4a6057f23f28a8692d"} Jul 22 12:04:11.981464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:11.981441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:12.297829 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.297798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"28249aa67a86d28c69b38016eeb99da43a82b5f5e995d7e504d3b96a5930cd39"} Jul 22 12:04:12.298162 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.297878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"fb5b6d0f753e232ff8c33c938659f17b2569675102b874071172761415df4e54"} Jul 22 12:04:12.298162 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.297912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"2f3b491c3e7fc3ba9dd583900cb1092cc5d71da60539cfc97b4ee2783cadacd7"} Jul 22 12:04:12.298162 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.297938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"a66018443dbd94dfc137c9eab90ad14553fdd93caaf9735f6640817823fc6037"} Jul 22 12:04:12.300781 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.300710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"62fc11aedbb2e5cdf1639de86104bd5d6a258ad3ad4e505390e300cc1176d9e0"} Jul 22 12:04:12.300781 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.300776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"7daa3f4ad9624f0f8e5e46672f918f72248bdcc5a9ee8c94d557fbb1f79ef98e"} Jul 22 12:04:12.300926 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.300817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" event={"ID":"1e4e0a78-7b96-4809-8bd8-b8fc5705ad47","Type":"ContainerStarted","Data":"0126756d03980ffd1b2001da014ec4469a3f8d864df32df898ff5e621190e2aa"} Jul 22 12:04:12.342467 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.342431 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b8cf6d8b9-vdpnj" podStartSLOduration=2.342417593 podStartE2EDuration="2.342417593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:11.307608388 +0000 UTC m=+155.327998481" watchObservedRunningTime="2026-07-22 12:04:12.342417593 +0000 UTC m=+156.362807694" Jul 22 12:04:12.343356 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:12.343187 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" podStartSLOduration=8.630972682 podStartE2EDuration="17.343172403s" totalImagesPullingTime="8.712199721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:12.341545745 +0000 UTC m=+156.361935850" watchObservedRunningTime="2026-07-22 12:04:12.343172403 +0000 UTC m=+156.363562509" Jul 22 12:04:13.307537 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:13.307498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"f63cec4e4d48e8e08a0d95d1949836f0408ad0b68e7faed715d0db52b3cca4a1"} Jul 22 12:04:13.307994 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:13.307639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:04:13.307994 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:13.307704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerStarted","Data":"b8dccd38d350a1aef0de9f029c46f17bac819fdb9e2ac3085464d85098d83b90"} Jul 22 12:04:13.314083 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:13.314030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c645c6b95-cxhwl" Jul 22 12:04:13.336937 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:13.336898 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=11.413220981 podStartE2EDuration="19.336885018s" totalImagesPullingTime="7.902103562s" totalInitContainerRuntime="21.560475ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:03:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:13.334691153 +0000 UTC m=+157.355081257" watchObservedRunningTime="2026-07-22 12:04:13.336885018 +0000 UTC m=+157.357275118" Jul 22 12:04:14.386063 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:14.386005 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lfz8n" podUID="f3deab09-41a9-4ad6-8742-fb23987876c4" Jul 22 12:04:15.320921 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:15.320893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:18.602232 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:18.602199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:04:18.602583 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:18.602248 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:04:19.274987 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:19.274947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:19.277326 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:19.277304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3deab09-41a9-4ad6-8742-fb23987876c4-metrics-tls\") pod \"dns-default-lfz8n\" (UID: \"f3deab09-41a9-4ad6-8742-fb23987876c4\") " pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:19.523711 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:19.523686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9wgb\"" Jul 22 12:04:19.531530 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:19.531480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:19.775008 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:19.774987 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfz8n"] Jul 22 12:04:19.776802 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:04:19.776778 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3deab09_41a9_4ad6_8742_fb23987876c4.slice/crio-8e0ca8043c48df8650111a24da512261cf089da6f8340854aeb9dc2e830dec40 WatchSource:0}: Error finding container 8e0ca8043c48df8650111a24da512261cf089da6f8340854aeb9dc2e830dec40: Status 404 returned error can't find the container with id 8e0ca8043c48df8650111a24da512261cf089da6f8340854aeb9dc2e830dec40 Jul 22 12:04:20.344513 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:20.344483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfz8n" event={"ID":"f3deab09-41a9-4ad6-8742-fb23987876c4","Type":"ContainerStarted","Data":"8e0ca8043c48df8650111a24da512261cf089da6f8340854aeb9dc2e830dec40"} Jul 22 12:04:20.626487 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:20.626442 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:20.626487 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:20.626482 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:20.630903 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:20.630887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:21.353694 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:21.353666 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:04:23.360526 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:23.360486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfz8n" event={"ID":"f3deab09-41a9-4ad6-8742-fb23987876c4","Type":"ContainerStarted","Data":"4046d7f3581b37fbb93ef76c04df2312449edaef51124b7f70cf2a2e1c3e2c3a"} Jul 22 12:04:23.360907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:23.360550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfz8n" event={"ID":"f3deab09-41a9-4ad6-8742-fb23987876c4","Type":"ContainerStarted","Data":"dd81a129ead310c615017ab0815b17f5c8414c6147076dbabc218ebca5a75264"} Jul 22 12:04:23.360907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:23.360635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:23.383310 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:23.383263 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lfz8n" podStartSLOduration=129.803785924 podStartE2EDuration="2m12.383248693s" totalImagesPullingTime="2.579462769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:04:23.381741209 +0000 UTC m=+167.402131343" watchObservedRunningTime="2026-07-22 12:04:23.383248693 +0000 UTC m=+167.403638795" Jul 22 12:04:26.375646 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.375618 2564 generic.go:356] "Generic (PLEG): container finished" podID="bf85f063-1b03-4c87-af1d-1284fa950651" containerID="fb8eb07dcd03dc30fbfb3026ec48960e9abe9112588a83fa40f16da9eb8f083d" exitCode=0 Jul 22 12:04:26.375957 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.375683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-thvgj" event={"ID":"bf85f063-1b03-4c87-af1d-1284fa950651","Type":"ContainerDied","Data":"fb8eb07dcd03dc30fbfb3026ec48960e9abe9112588a83fa40f16da9eb8f083d"} Jul 22 12:04:26.375995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.375974 2564 scope.go:117] "RemoveContainer" containerID="fb8eb07dcd03dc30fbfb3026ec48960e9abe9112588a83fa40f16da9eb8f083d" Jul 22 12:04:26.564169 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.564095 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77974c9f7f-bzdp2" podUID="6616f0df-6b1b-4618-aec7-42e358fff899" containerName="console" containerID="cri-o://0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a" gracePeriod=15 Jul 22 12:04:26.837846 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.837785 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:04:26.933965 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.933934 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934136 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.933967 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934136 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.933989 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934136 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934098 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934305 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934141 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhvzk\" (UniqueName: \"kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934305 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934215 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca\") pod \"6616f0df-6b1b-4618-aec7-42e358fff899\" (UID: \"6616f0df-6b1b-4618-aec7-42e358fff899\") " Jul 22 12:04:26.934435 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934360 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:26.934594 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934564 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config" (OuterVolumeSpecName: "console-config") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:26.934662 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934577 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-oauth-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:26.934797 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.934778 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca" (OuterVolumeSpecName: "service-ca") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:26.936222 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.936194 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:26.936302 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.936235 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:26.936302 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:26.936275 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk" (OuterVolumeSpecName: "kube-api-access-vhvzk") pod "6616f0df-6b1b-4618-aec7-42e358fff899" (UID: "6616f0df-6b1b-4618-aec7-42e358fff899"). InnerVolumeSpecName "kube-api-access-vhvzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:04:27.035028 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.035009 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-service-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:27.035028 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.035028 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-oauth-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:27.035189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.035037 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6616f0df-6b1b-4618-aec7-42e358fff899-console-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:27.035189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.035055 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6616f0df-6b1b-4618-aec7-42e358fff899-console-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:27.035189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.035063 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhvzk\" (UniqueName: \"kubernetes.io/projected/6616f0df-6b1b-4618-aec7-42e358fff899-kube-api-access-vhvzk\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:27.382235 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.382201 2564 generic.go:356] "Generic (PLEG): container finished" podID="6616f0df-6b1b-4618-aec7-42e358fff899" containerID="0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a" exitCode=0 Jul 22 12:04:27.382594 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.382248 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77974c9f7f-bzdp2" Jul 22 12:04:27.382594 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.382286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77974c9f7f-bzdp2" event={"ID":"6616f0df-6b1b-4618-aec7-42e358fff899","Type":"ContainerDied","Data":"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a"} Jul 22 12:04:27.382594 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.382363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77974c9f7f-bzdp2" event={"ID":"6616f0df-6b1b-4618-aec7-42e358fff899","Type":"ContainerDied","Data":"6fc0aa133d9fde6641b2b927aa30fd1fb7eafa34ad8a3926ecabb96092664d9d"} Jul 22 12:04:27.382594 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.382390 2564 scope.go:117] "RemoveContainer" containerID="0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a" Jul 22 12:04:27.384311 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.384283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-thvgj" event={"ID":"bf85f063-1b03-4c87-af1d-1284fa950651","Type":"ContainerStarted","Data":"8aece2903a4b903e36c0d616a11f7030074624c4bb58f1bcc7e0a5b149786da6"} Jul 22 12:04:27.390940 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.390925 2564 scope.go:117] "RemoveContainer" containerID="0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a" Jul 22 12:04:27.391218 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:27.391199 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a\": container with ID starting with 0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a not found: ID does not exist" containerID="0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a" Jul 22 12:04:27.391278 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.391238 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a"} err="failed to get container status \"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a\": rpc error: code = NotFound desc = could not find container \"0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a\": container with ID starting with 0de6898c22e4a652f128dbc2fe99bf42db889f11cc2c72efd60a54ec3120b92a not found: ID does not exist" Jul 22 12:04:27.423772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.423747 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:04:27.427444 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:27.427422 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77974c9f7f-bzdp2"] Jul 22 12:04:28.593803 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:28.593729 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6616f0df-6b1b-4618-aec7-42e358fff899" path="/var/lib/kubelet/pods/6616f0df-6b1b-4618-aec7-42e358fff899/volumes" Jul 22 12:04:32.410595 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:32.410559 2564 generic.go:356] "Generic (PLEG): container finished" podID="3b46a25a-4d8b-484b-ac34-f77f1d5a1c64" containerID="ba7663e52782d69191d2e71f9aac86bd0058b63367dd739ed29a94c90138f95f" exitCode=0 Jul 22 12:04:32.410979 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:32.410644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" event={"ID":"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64","Type":"ContainerDied","Data":"ba7663e52782d69191d2e71f9aac86bd0058b63367dd739ed29a94c90138f95f"} Jul 22 12:04:32.410979 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:32.410971 2564 scope.go:117] "RemoveContainer" containerID="ba7663e52782d69191d2e71f9aac86bd0058b63367dd739ed29a94c90138f95f" Jul 22 12:04:33.367721 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:33.367692 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lfz8n" Jul 22 12:04:33.416563 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:33.416531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xw6lf" event={"ID":"3b46a25a-4d8b-484b-ac34-f77f1d5a1c64","Type":"ContainerStarted","Data":"080901865bc96da0bf5e2ac866dc18278bdd9b6d30f9a7cdece52ef5fdc93f00"} Jul 22 12:04:35.275939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.275897 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dc7b5f548-dhxq4" podUID="68f9b9f6-481a-4583-bc73-fd31a412d600" containerName="console" containerID="cri-o://6c4e1599bdd91a762291dd2793a40bf43326d1cce00d6bf9a0d2a51167abdaf6" gracePeriod=15 Jul 22 12:04:35.428055 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.428009 2564 generic.go:356] "Generic (PLEG): container finished" podID="68f9b9f6-481a-4583-bc73-fd31a412d600" containerID="6c4e1599bdd91a762291dd2793a40bf43326d1cce00d6bf9a0d2a51167abdaf6" exitCode=0 Jul 22 12:04:35.428194 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.428084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc7b5f548-dhxq4" event={"ID":"68f9b9f6-481a-4583-bc73-fd31a412d600","Type":"ContainerDied","Data":"6c4e1599bdd91a762291dd2793a40bf43326d1cce00d6bf9a0d2a51167abdaf6"} Jul 22 12:04:35.520740 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.520720 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:35.595393 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.595341 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.595612 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.595593 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:35.696162 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696169 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696189 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696209 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhgnt\" (UniqueName: \"kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696234 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696256 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config\") pod \"68f9b9f6-481a-4583-bc73-fd31a412d600\" (UID: \"68f9b9f6-481a-4583-bc73-fd31a412d600\") " Jul 22 12:04:35.696606 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696399 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-oauth-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.696659 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696539 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca" (OuterVolumeSpecName: "service-ca") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:35.696704 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696653 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:35.696750 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.696714 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config" (OuterVolumeSpecName: "console-config") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:04:35.698268 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.698241 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:35.698356 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.698319 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt" (OuterVolumeSpecName: "kube-api-access-nhgnt") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "kube-api-access-nhgnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:04:35.698395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.698369 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68f9b9f6-481a-4583-bc73-fd31a412d600" (UID: "68f9b9f6-481a-4583-bc73-fd31a412d600"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:04:35.797185 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797164 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.797185 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797188 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-service-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.797301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797197 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.797301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797205 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhgnt\" (UniqueName: \"kubernetes.io/projected/68f9b9f6-481a-4583-bc73-fd31a412d600-kube-api-access-nhgnt\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.797301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797215 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f9b9f6-481a-4583-bc73-fd31a412d600-console-oauth-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:35.797301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:35.797224 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f9b9f6-481a-4583-bc73-fd31a412d600-console-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:04:36.434506 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.434475 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc7b5f548-dhxq4" Jul 22 12:04:36.434506 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.434500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc7b5f548-dhxq4" event={"ID":"68f9b9f6-481a-4583-bc73-fd31a412d600","Type":"ContainerDied","Data":"5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a"} Jul 22 12:04:36.434893 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.434565 2564 scope.go:117] "RemoveContainer" containerID="6c4e1599bdd91a762291dd2793a40bf43326d1cce00d6bf9a0d2a51167abdaf6" Jul 22 12:04:36.457941 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.457914 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:36.462895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.462872 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dc7b5f548-dhxq4"] Jul 22 12:04:36.593576 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:36.593543 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f9b9f6-481a-4583-bc73-fd31a412d600" path="/var/lib/kubelet/pods/68f9b9f6-481a-4583-bc73-fd31a412d600/volumes" Jul 22 12:04:36.959634 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:36.959608 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:04:38.608028 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:38.607997 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:04:38.612166 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:04:38.612142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79fc7b9889-9zq6r" Jul 22 12:04:38.888667 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:38.888591 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:04:47.004667 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:47.004635 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:04:53.871184 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:53.871149 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:04:57.055155 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:04:57.055121 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:03.346072 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:03.343292 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:03.346072 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:03.343292 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:07.064487 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:07.064445 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:08.913140 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:08.913104 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:14.043247 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043214 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:05:14.043668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043574 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f9b9f6-481a-4583-bc73-fd31a412d600" containerName="console" Jul 22 12:05:14.043668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043587 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f9b9f6-481a-4583-bc73-fd31a412d600" containerName="console" Jul 22 12:05:14.043668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043599 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6616f0df-6b1b-4618-aec7-42e358fff899" containerName="console" Jul 22 12:05:14.043668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043605 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6616f0df-6b1b-4618-aec7-42e358fff899" containerName="console" Jul 22 12:05:14.043789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043677 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6616f0df-6b1b-4618-aec7-42e358fff899" containerName="console" Jul 22 12:05:14.043789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.043686 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f9b9f6-481a-4583-bc73-fd31a412d600" containerName="console" Jul 22 12:05:14.046460 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.046440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.062601 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.062577 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:05:14.079434 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079557 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079557 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079557 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079720 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079720 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.079720 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.079664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkhtr\" (UniqueName: \"kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180609 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180717 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkhtr\" (UniqueName: \"kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180717 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180717 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.180969 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.180919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.181398 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.181372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.181504 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.181442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.181571 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.181521 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.181629 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.181610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.183129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.183101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.183362 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.183341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.191223 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.191204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkhtr\" (UniqueName: \"kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr\") pod \"console-7bb9dd64d9-89v9h\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.355531 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.355469 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:14.462533 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.462502 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:14.462815 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.462791 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="alertmanager" containerID="cri-o://a66018443dbd94dfc137c9eab90ad14553fdd93caaf9735f6640817823fc6037" gracePeriod=120 Jul 22 12:05:14.462916 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.462864 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-metric" containerID="cri-o://f63cec4e4d48e8e08a0d95d1949836f0408ad0b68e7faed715d0db52b3cca4a1" gracePeriod=120 Jul 22 12:05:14.462980 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.462942 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy" containerID="cri-o://28249aa67a86d28c69b38016eeb99da43a82b5f5e995d7e504d3b96a5930cd39" gracePeriod=120 Jul 22 12:05:14.463059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.463006 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-web" containerID="cri-o://fb5b6d0f753e232ff8c33c938659f17b2569675102b874071172761415df4e54" gracePeriod=120 Jul 22 12:05:14.463126 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.463073 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="config-reloader" containerID="cri-o://2f3b491c3e7fc3ba9dd583900cb1092cc5d71da60539cfc97b4ee2783cadacd7" gracePeriod=120 Jul 22 12:05:14.463212 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.463158 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="prom-label-proxy" containerID="cri-o://b8dccd38d350a1aef0de9f029c46f17bac819fdb9e2ac3085464d85098d83b90" gracePeriod=120 Jul 22 12:05:14.489782 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.489759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:05:14.494265 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:05:14.494243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc415929_0118_449e_86b4_ea78283c5db6.slice/crio-6224a6b77044e8d31b6609e61ac991c9923ae7b331c519e3d1ea3975b55274ef WatchSource:0}: Error finding container 6224a6b77044e8d31b6609e61ac991c9923ae7b331c519e3d1ea3975b55274ef: Status 404 returned error can't find the container with id 6224a6b77044e8d31b6609e61ac991c9923ae7b331c519e3d1ea3975b55274ef Jul 22 12:05:14.622503 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.622476 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb9dd64d9-89v9h" event={"ID":"cc415929-0118-449e-86b4-ea78283c5db6","Type":"ContainerStarted","Data":"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09"} Jul 22 12:05:14.622619 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.622524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb9dd64d9-89v9h" event={"ID":"cc415929-0118-449e-86b4-ea78283c5db6","Type":"ContainerStarted","Data":"6224a6b77044e8d31b6609e61ac991c9923ae7b331c519e3d1ea3975b55274ef"} Jul 22 12:05:14.625865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625844 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="b8dccd38d350a1aef0de9f029c46f17bac819fdb9e2ac3085464d85098d83b90" exitCode=0 Jul 22 12:05:14.625865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625865 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="f63cec4e4d48e8e08a0d95d1949836f0408ad0b68e7faed715d0db52b3cca4a1" exitCode=0 Jul 22 12:05:14.625977 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625872 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="28249aa67a86d28c69b38016eeb99da43a82b5f5e995d7e504d3b96a5930cd39" exitCode=0 Jul 22 12:05:14.625977 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625878 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="2f3b491c3e7fc3ba9dd583900cb1092cc5d71da60539cfc97b4ee2783cadacd7" exitCode=0 Jul 22 12:05:14.625977 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625883 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="a66018443dbd94dfc137c9eab90ad14553fdd93caaf9735f6640817823fc6037" exitCode=0 Jul 22 12:05:14.625977 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"b8dccd38d350a1aef0de9f029c46f17bac819fdb9e2ac3085464d85098d83b90"} Jul 22 12:05:14.625977 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"f63cec4e4d48e8e08a0d95d1949836f0408ad0b68e7faed715d0db52b3cca4a1"} Jul 22 12:05:14.626146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.625988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"28249aa67a86d28c69b38016eeb99da43a82b5f5e995d7e504d3b96a5930cd39"} Jul 22 12:05:14.626146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.626012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"2f3b491c3e7fc3ba9dd583900cb1092cc5d71da60539cfc97b4ee2783cadacd7"} Jul 22 12:05:14.626146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.626035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"a66018443dbd94dfc137c9eab90ad14553fdd93caaf9735f6640817823fc6037"} Jul 22 12:05:14.647227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:14.647180 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb9dd64d9-89v9h" podStartSLOduration=0.647162559 podStartE2EDuration="647.162559ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:05:14.644772935 +0000 UTC m=+218.665163038" watchObservedRunningTime="2026-07-22 12:05:14.647162559 +0000 UTC m=+218.667552661" Jul 22 12:05:15.635351 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.635324 2564 generic.go:356] "Generic (PLEG): container finished" podID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerID="fb5b6d0f753e232ff8c33c938659f17b2569675102b874071172761415df4e54" exitCode=0 Jul 22 12:05:15.635752 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.635416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"fb5b6d0f753e232ff8c33c938659f17b2569675102b874071172761415df4e54"} Jul 22 12:05:15.700737 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.700717 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:15.791741 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791721 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.791884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791763 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.791884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791788 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.791884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791810 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.791884 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791861 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791893 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791921 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791966 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t78wv\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.791998 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792033 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792094 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792126 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792473 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792148 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\" (UID: \"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3\") " Jul 22 12:05:15.792473 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792317 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:15.792473 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792383 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-metrics-client-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.792628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792509 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:05:15.792730 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.792705 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:15.794606 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.794575 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.795154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.794858 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.795154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.794933 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv" (OuterVolumeSpecName: "kube-api-access-t78wv") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "kube-api-access-t78wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:05:15.795154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.795113 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.795154 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.795121 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out" (OuterVolumeSpecName: "config-out") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:05:15.795439 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.795200 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:05:15.796669 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.796640 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.796841 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.796818 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume" (OuterVolumeSpecName: "config-volume") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.798655 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.798636 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.804754 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.804737 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config" (OuterVolumeSpecName: "web-config") pod "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" (UID: "fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:15.893401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893370 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893401 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893402 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893414 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t78wv\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-kube-api-access-t78wv\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893422 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-alertmanager-main-db\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893431 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893442 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-volume\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893451 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-tls-assets\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893459 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893467 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-config-out\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893475 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-cluster-tls-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893483 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-secret-alertmanager-main-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:15.893520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:15.893491 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3-web-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:16.642816 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.642788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3","Type":"ContainerDied","Data":"2b71dfb54bda45064d878d82f1adbe1a9a1f86020c59fb19660a382c02e3b7a4"} Jul 22 12:05:16.643143 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.642829 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.643143 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.642876 2564 scope.go:117] "RemoveContainer" containerID="b8dccd38d350a1aef0de9f029c46f17bac819fdb9e2ac3085464d85098d83b90" Jul 22 12:05:16.653242 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.653221 2564 scope.go:117] "RemoveContainer" containerID="f63cec4e4d48e8e08a0d95d1949836f0408ad0b68e7faed715d0db52b3cca4a1" Jul 22 12:05:16.660327 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.660303 2564 scope.go:117] "RemoveContainer" containerID="28249aa67a86d28c69b38016eeb99da43a82b5f5e995d7e504d3b96a5930cd39" Jul 22 12:05:16.665634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.665612 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:16.668610 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.668589 2564 scope.go:117] "RemoveContainer" containerID="fb5b6d0f753e232ff8c33c938659f17b2569675102b874071172761415df4e54" Jul 22 12:05:16.669686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.669667 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:16.675359 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.675344 2564 scope.go:117] "RemoveContainer" containerID="2f3b491c3e7fc3ba9dd583900cb1092cc5d71da60539cfc97b4ee2783cadacd7" Jul 22 12:05:16.681869 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.681852 2564 scope.go:117] "RemoveContainer" containerID="a66018443dbd94dfc137c9eab90ad14553fdd93caaf9735f6640817823fc6037" Jul 22 12:05:16.688772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.688752 2564 scope.go:117] "RemoveContainer" containerID="4f540f18f47a412a8c7f9f8afe0b43b5e07a76fa136dad93bc92d5b853b1c6e2" Jul 22 12:05:16.701605 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.701584 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:16.701993 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.701980 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="alertmanager" Jul 22 12:05:16.702065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.701996 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="alertmanager" Jul 22 12:05:16.702065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702015 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="init-config-reloader" Jul 22 12:05:16.702065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702023 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="init-config-reloader" Jul 22 12:05:16.702065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702057 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="prom-label-proxy" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702066 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="prom-label-proxy" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702080 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-web" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702089 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-web" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702100 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702108 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702117 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-metric" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702124 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-metric" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702145 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="config-reloader" Jul 22 12:05:16.702189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702153 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="config-reloader" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702219 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="prom-label-proxy" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702233 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-web" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702244 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="config-reloader" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702252 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="alertmanager" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702260 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy" Jul 22 12:05:16.702425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.702267 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" containerName="kube-rbac-proxy-metric" Jul 22 12:05:16.706113 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.706089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.709576 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.709559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 12:05:16.710227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710030 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 12:05:16.710227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710036 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 12:05:16.710227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 12:05:16.710427 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710287 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 12:05:16.710427 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 12:05:16.710427 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710412 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 12:05:16.710668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 12:05:16.710668 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.710659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4d27m\"" Jul 22 12:05:16.717360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.717338 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 12:05:16.726517 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.726496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:16.799806 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.799903 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.799903 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-out\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.799943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f2t\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-kube-api-access-97f2t\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800271 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800271 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-web-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.800271 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.800208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901490 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-web-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-out\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.901692 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.902024 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.902024 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.902024 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.901751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97f2t\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-kube-api-access-97f2t\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.902302 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.902280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.902534 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.902507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.903382 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.903357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37e8d675-b1a3-49f5-b9aa-535d90336c02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.904704 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.904675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.904800 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.904777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.904873 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.904847 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-web-config\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.904972 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.904873 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.904972 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.904950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.905086 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.905065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-out\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.905312 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.905291 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.906116 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.906095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.906776 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.906756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37e8d675-b1a3-49f5-b9aa-535d90336c02-config-volume\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:16.912139 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:16.912117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f2t\" (UniqueName: \"kubernetes.io/projected/37e8d675-b1a3-49f5-b9aa-535d90336c02-kube-api-access-97f2t\") pod \"alertmanager-main-0\" (UID: \"37e8d675-b1a3-49f5-b9aa-535d90336c02\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:17.016968 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:17.016950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:05:17.107903 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:17.107877 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:17.155124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:17.155100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:05:17.155886 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:05:17.155866 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e8d675_b1a3_49f5_b9aa_535d90336c02.slice/crio-4a2298f72bf4f5c0839b439bcf44a4f8b92b757c6473a74e3244a4a1ecc80f77 WatchSource:0}: Error finding container 4a2298f72bf4f5c0839b439bcf44a4f8b92b757c6473a74e3244a4a1ecc80f77: Status 404 returned error can't find the container with id 4a2298f72bf4f5c0839b439bcf44a4f8b92b757c6473a74e3244a4a1ecc80f77 Jul 22 12:05:17.649684 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:17.649653 2564 generic.go:356] "Generic (PLEG): container finished" podID="37e8d675-b1a3-49f5-b9aa-535d90336c02" containerID="d1947f29b0e7b3b85d6ba0206883e64daf27b490e5f54bc5ff7950ec011f347d" exitCode=0 Jul 22 12:05:17.650092 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:17.649748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerDied","Data":"d1947f29b0e7b3b85d6ba0206883e64daf27b490e5f54bc5ff7950ec011f347d"} Jul 22 12:05:17.650092 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:17.649818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"4a2298f72bf4f5c0839b439bcf44a4f8b92b757c6473a74e3244a4a1ecc80f77"} Jul 22 12:05:18.597159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.597121 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3" path="/var/lib/kubelet/pods/fb5b1155-7b73-4d8c-8c7b-6b9f0a5334d3/volumes" Jul 22 12:05:18.659326 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"51f6a947bd8358ffb67207174da9b7f4d74acb21fe82839ebf15921983dca39c"} Jul 22 12:05:18.659640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"ab399f096502584f463709e3ec75e716aa3f9c6277e335ef57ad81f56c86bee8"} Jul 22 12:05:18.659640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"46fa0bad74909c823bc3bc3aeb4412c1f802119744a8a20c1ca9d09d9629acc4"} Jul 22 12:05:18.659640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"4987342f1a9253289b96050b345c77a276b6462130b0c9a0b54b5f8205a4a844"} Jul 22 12:05:18.659640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"4202af121937549a0fcef06a88b3520b23d9417ed78116cd036214e4a710ac8f"} Jul 22 12:05:18.659640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.659534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37e8d675-b1a3-49f5-b9aa-535d90336c02","Type":"ContainerStarted","Data":"6219fcf140b8689911d6d34e0ea824d53cf142e7775704e176de20d78ee0d2ff"} Jul 22 12:05:18.692760 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:18.692709 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.679851445 podStartE2EDuration="2.692690406s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.838961ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:05:18.691468225 +0000 UTC m=+222.711858342" watchObservedRunningTime="2026-07-22 12:05:18.692690406 +0000 UTC m=+222.713080509" Jul 22 12:05:23.907931 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:23.907891 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:24.356008 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:24.355977 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:24.356223 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:24.356083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:24.360546 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:24.360518 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:24.691029 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:24.690958 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:05:24.753111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:24.753077 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:05:27.116828 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:27.116786 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9b9f6_481a_4583_bc73_fd31a412d600.slice/crio-5195a27c0daaa1a466c47e619f9cb5a015d9330550be06c3e0609e3d4e46d43a\": RecentStats: unable to find data in memory cache]" Jul 22 12:05:49.774925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:49.774880 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b8cf6d8b9-vdpnj" podUID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" containerName="console" containerID="cri-o://2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa" gracePeriod=15 Jul 22 12:05:50.016682 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.016662 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:05:50.141948 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.141886 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.141948 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.141927 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xblx\" (UniqueName: \"kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.141964 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142015 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142037 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142340 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142145 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config\") pod \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\" (UID: \"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96\") " Jul 22 12:05:50.142340 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142299 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:50.142450 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142352 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca" (OuterVolumeSpecName: "service-ca") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:50.142500 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142483 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.142554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142532 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config" (OuterVolumeSpecName: "console-config") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:50.142619 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.142600 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:05:50.144089 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.144069 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:50.144168 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.144106 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx" (OuterVolumeSpecName: "kube-api-access-9xblx") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "kube-api-access-9xblx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:05:50.144168 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.144106 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" (UID: "7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:05:50.243016 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.242992 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xblx\" (UniqueName: \"kubernetes.io/projected/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-kube-api-access-9xblx\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.243016 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.243014 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-service-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.243159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.243023 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-oauth-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.243159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.243032 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.243159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.243059 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-oauth-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.243159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.243067 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96-console-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:05:50.805863 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.805830 2564 generic.go:356] "Generic (PLEG): container finished" podID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" containerID="2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa" exitCode=0 Jul 22 12:05:50.806328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.805871 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8cf6d8b9-vdpnj" Jul 22 12:05:50.806328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.805909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8cf6d8b9-vdpnj" event={"ID":"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96","Type":"ContainerDied","Data":"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa"} Jul 22 12:05:50.806328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.805959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8cf6d8b9-vdpnj" event={"ID":"7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96","Type":"ContainerDied","Data":"8150f6e4bdc2fd6ad12c5edf3688a0049f2807680f372e4a6057f23f28a8692d"} Jul 22 12:05:50.806328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.805983 2564 scope.go:117] "RemoveContainer" containerID="2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa" Jul 22 12:05:50.814236 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.814219 2564 scope.go:117] "RemoveContainer" containerID="2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa" Jul 22 12:05:50.814490 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:05:50.814471 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa\": container with ID starting with 2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa not found: ID does not exist" containerID="2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa" Jul 22 12:05:50.814545 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.814497 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa"} err="failed to get container status \"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa\": rpc error: code = NotFound desc = could not find container \"2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa\": container with ID starting with 2491a82f212f67451183729f5e5bf2cc6873d4294ad233d3ac0b6cd0f6d5c8aa not found: ID does not exist" Jul 22 12:05:50.830277 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.830253 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:05:50.835194 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:50.835173 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8cf6d8b9-vdpnj"] Jul 22 12:05:52.594198 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:52.594170 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" path="/var/lib/kubelet/pods/7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96/volumes" Jul 22 12:05:55.505142 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.505109 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p"] Jul 22 12:05:55.505562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.505419 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" containerName="console" Jul 22 12:05:55.505562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.505431 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" containerName="console" Jul 22 12:05:55.505562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.505505 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7088c0ba-4ce2-4a18-8cf0-8f3a0421ed96" containerName="console" Jul 22 12:05:55.508214 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.508200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.510891 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.510867 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:05:55.511633 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.511619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nk6xp\"" Jul 22 12:05:55.511710 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.511621 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:05:55.519176 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.519156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p"] Jul 22 12:05:55.682562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.682532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.682659 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.682580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.682699 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.682670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz48p\" (UniqueName: \"kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.783237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.783211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.783321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.783262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz48p\" (UniqueName: \"kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.783395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.783374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.783579 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.783562 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.783689 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.783670 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.801258 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.801231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz48p\" (UniqueName: \"kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.816580 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.816561 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:05:55.945023 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:55.944998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p"] Jul 22 12:05:55.947730 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:05:55.947704 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868e7eb2_8926_4daf_a1b1_d1421b74ac3b.slice/crio-147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec WatchSource:0}: Error finding container 147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec: Status 404 returned error can't find the container with id 147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec Jul 22 12:05:56.833090 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:05:56.833058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" event={"ID":"868e7eb2-8926-4daf-a1b1-d1421b74ac3b","Type":"ContainerStarted","Data":"147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec"} Jul 22 12:06:03.870344 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:03.870287 2564 generic.go:356] "Generic (PLEG): container finished" podID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerID="1b14a8bb9f896499586987cb48e5f9066e13d86e803295d9e7f4ea4f41c167e7" exitCode=0 Jul 22 12:06:03.870670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:03.870369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" event={"ID":"868e7eb2-8926-4daf-a1b1-d1421b74ac3b","Type":"ContainerDied","Data":"1b14a8bb9f896499586987cb48e5f9066e13d86e803295d9e7f4ea4f41c167e7"} Jul 22 12:06:07.891267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:07.891239 2564 generic.go:356] "Generic (PLEG): container finished" podID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerID="1d43d2344e9a1e42aacb501a3171623f19ee4322b8b9202aaed1171aed85f9c6" exitCode=0 Jul 22 12:06:07.891593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:07.891322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" event={"ID":"868e7eb2-8926-4daf-a1b1-d1421b74ac3b","Type":"ContainerDied","Data":"1d43d2344e9a1e42aacb501a3171623f19ee4322b8b9202aaed1171aed85f9c6"} Jul 22 12:06:15.930605 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:15.930574 2564 generic.go:356] "Generic (PLEG): container finished" podID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerID="79fff1d93c79d7ef370170a02d2bb5917a5a4f1ca93bbc533e3d5f1604749b1d" exitCode=0 Jul 22 12:06:15.930897 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:15.930615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" event={"ID":"868e7eb2-8926-4daf-a1b1-d1421b74ac3b","Type":"ContainerDied","Data":"79fff1d93c79d7ef370170a02d2bb5917a5a4f1ca93bbc533e3d5f1604749b1d"} Jul 22 12:06:17.056261 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.056238 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:06:17.149544 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.149524 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle\") pod \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " Jul 22 12:06:17.149676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.149582 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz48p\" (UniqueName: \"kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p\") pod \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " Jul 22 12:06:17.149676 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.149649 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util\") pod \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\" (UID: \"868e7eb2-8926-4daf-a1b1-d1421b74ac3b\") " Jul 22 12:06:17.150281 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.150257 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle" (OuterVolumeSpecName: "bundle") pod "868e7eb2-8926-4daf-a1b1-d1421b74ac3b" (UID: "868e7eb2-8926-4daf-a1b1-d1421b74ac3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:17.151632 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.151605 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p" (OuterVolumeSpecName: "kube-api-access-hz48p") pod "868e7eb2-8926-4daf-a1b1-d1421b74ac3b" (UID: "868e7eb2-8926-4daf-a1b1-d1421b74ac3b"). InnerVolumeSpecName "kube-api-access-hz48p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:06:17.154519 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.154499 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util" (OuterVolumeSpecName: "util") pod "868e7eb2-8926-4daf-a1b1-d1421b74ac3b" (UID: "868e7eb2-8926-4daf-a1b1-d1421b74ac3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:17.251018 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.250974 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:17.251018 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.250992 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:17.251018 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.251001 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz48p\" (UniqueName: \"kubernetes.io/projected/868e7eb2-8926-4daf-a1b1-d1421b74ac3b-kube-api-access-hz48p\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:17.940376 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.940352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" event={"ID":"868e7eb2-8926-4daf-a1b1-d1421b74ac3b","Type":"ContainerDied","Data":"147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec"} Jul 22 12:06:17.940376 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.940366 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gbl9p" Jul 22 12:06:17.940541 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:17.940388 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147e5fed9ae61946610e0a670d3338f57e863f15c2f809be2e04bdbae3c9fbec" Jul 22 12:06:23.741695 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.741667 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf"] Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.741969 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="extract" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.741980 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="extract" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.742010 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="pull" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.742016 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="pull" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.742023 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="util" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.742028 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="util" Jul 22 12:06:23.742157 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.742106 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="868e7eb2-8926-4daf-a1b1-d1421b74ac3b" containerName="extract" Jul 22 12:06:23.745880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.745861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.751064 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.751019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:06:23.751064 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.751057 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jklvt\"" Jul 22 12:06:23.751228 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.751021 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 12:06:23.765244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.765220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf"] Jul 22 12:06:23.794994 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.794970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jhf\" (UniqueName: \"kubernetes.io/projected/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-kube-api-access-s6jhf\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.795111 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.795014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.895272 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.895242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jhf\" (UniqueName: \"kubernetes.io/projected/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-kube-api-access-s6jhf\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.895377 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.895307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.895652 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.895633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:23.909597 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:23.909575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jhf\" (UniqueName: \"kubernetes.io/projected/e9eb7e8c-fc4d-4910-b4db-a07fe870c129-kube-api-access-s6jhf\") pod \"cert-manager-operator-controller-manager-55c444bf86-klnmf\" (UID: \"e9eb7e8c-fc4d-4910-b4db-a07fe870c129\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:24.054470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:24.054450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" Jul 22 12:06:24.189711 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:24.189683 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9eb7e8c_fc4d_4910_b4db_a07fe870c129.slice/crio-ff012be52d1f5281d4858b9495c9d8c836c6d389fa4594168746177aec67df68 WatchSource:0}: Error finding container ff012be52d1f5281d4858b9495c9d8c836c6d389fa4594168746177aec67df68: Status 404 returned error can't find the container with id ff012be52d1f5281d4858b9495c9d8c836c6d389fa4594168746177aec67df68 Jul 22 12:06:24.189872 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:24.189851 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf"] Jul 22 12:06:24.971391 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:24.971358 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" event={"ID":"e9eb7e8c-fc4d-4910-b4db-a07fe870c129","Type":"ContainerStarted","Data":"ff012be52d1f5281d4858b9495c9d8c836c6d389fa4594168746177aec67df68"} Jul 22 12:06:27.987671 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:27.987642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" event={"ID":"e9eb7e8c-fc4d-4910-b4db-a07fe870c129","Type":"ContainerStarted","Data":"7a0dbe4834098ec771b1450ae36077ea4b166a497b009ef8ee2bb712982932d0"} Jul 22 12:06:28.012880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.012839 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-klnmf" podStartSLOduration=1.7411034029999999 podStartE2EDuration="5.012826346s" totalImagesPullingTime="3.271722943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:06:28.011556856 +0000 UTC m=+292.031946956" watchObservedRunningTime="2026-07-22 12:06:28.012826346 +0000 UTC m=+292.033216447" Jul 22 12:06:28.771831 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.771797 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj"] Jul 22 12:06:28.774205 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.774189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.776812 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.776788 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nk6xp\"" Jul 22 12:06:28.776932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.776787 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:06:28.777579 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.777560 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:06:28.787982 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.787959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj"] Jul 22 12:06:28.832518 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.832494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.832650 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.832552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.832650 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.832572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5js\" (UniqueName: \"kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.933587 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.933559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.933714 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.933610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.933714 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.933628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5js\" (UniqueName: \"kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.933923 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.933903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.933989 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.933944 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:28.951470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:28.951449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5js\" (UniqueName: \"kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:29.083841 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:29.083820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:29.216634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:29.216608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj"] Jul 22 12:06:29.217404 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:29.217381 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da63ddf_db3c_41df_b36b_51b853a9839c.slice/crio-cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89 WatchSource:0}: Error finding container cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89: Status 404 returned error can't find the container with id cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89 Jul 22 12:06:30.000326 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.000295 2564 generic.go:356] "Generic (PLEG): container finished" podID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerID="93001430bffc711fd9b68e5f645cf36736f34e9e68d6658f692a6f34f2c22e16" exitCode=0 Jul 22 12:06:30.000460 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.000346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" event={"ID":"7da63ddf-db3c-41df-b36b-51b853a9839c","Type":"ContainerDied","Data":"93001430bffc711fd9b68e5f645cf36736f34e9e68d6658f692a6f34f2c22e16"} Jul 22 12:06:30.000460 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.000382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" event={"ID":"7da63ddf-db3c-41df-b36b-51b853a9839c","Type":"ContainerStarted","Data":"cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89"} Jul 22 12:06:30.952072 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.952023 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zh48p"] Jul 22 12:06:30.954763 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.954745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:30.957178 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.957158 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l67jn\"" Jul 22 12:06:30.957963 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.957939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 12:06:30.958092 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.957939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 12:06:30.965551 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:30.965529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zh48p"] Jul 22 12:06:31.051137 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.051111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.051282 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.051167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztdf4\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-kube-api-access-ztdf4\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.152119 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.152086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.152257 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.152151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztdf4\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-kube-api-access-ztdf4\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.163559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.163531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztdf4\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-kube-api-access-ztdf4\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.164549 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.164529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94289031-6b56-4c09-b427-de13d49764d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zh48p\" (UID: \"94289031-6b56-4c09-b427-de13d49764d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.273321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.273296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" Jul 22 12:06:31.412551 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:31.412523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zh48p"] Jul 22 12:06:31.999771 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:31.999738 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94289031_6b56_4c09_b427_de13d49764d2.slice/crio-4306d6e6efaa261d926cbff401224a0c78c58c9cf5e447d116092747905e8795 WatchSource:0}: Error finding container 4306d6e6efaa261d926cbff401224a0c78c58c9cf5e447d116092747905e8795: Status 404 returned error can't find the container with id 4306d6e6efaa261d926cbff401224a0c78c58c9cf5e447d116092747905e8795 Jul 22 12:06:32.011096 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:32.011068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" event={"ID":"94289031-6b56-4c09-b427-de13d49764d2","Type":"ContainerStarted","Data":"4306d6e6efaa261d926cbff401224a0c78c58c9cf5e447d116092747905e8795"} Jul 22 12:06:33.019319 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:33.019285 2564 generic.go:356] "Generic (PLEG): container finished" podID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerID="dfbea0b3aa8a705b818975755cc47a6e7038da76a706152f9a28f2dfd5a51a40" exitCode=0 Jul 22 12:06:33.019718 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:33.019350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" event={"ID":"7da63ddf-db3c-41df-b36b-51b853a9839c","Type":"ContainerDied","Data":"dfbea0b3aa8a705b818975755cc47a6e7038da76a706152f9a28f2dfd5a51a40"} Jul 22 12:06:34.028052 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:34.027995 2564 generic.go:356] "Generic (PLEG): container finished" podID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerID="a1c4c2753b01be007649e44e533c74bd480132238071963e6b500ab13055acf4" exitCode=0 Jul 22 12:06:34.028456 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:34.028083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" event={"ID":"7da63ddf-db3c-41df-b36b-51b853a9839c","Type":"ContainerDied","Data":"a1c4c2753b01be007649e44e533c74bd480132238071963e6b500ab13055acf4"} Jul 22 12:06:35.034702 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.034663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" event={"ID":"94289031-6b56-4c09-b427-de13d49764d2","Type":"ContainerStarted","Data":"c5c997e279ee6590449d2a7dd428548c95166628648e07ed6794064cfd6d2e03"} Jul 22 12:06:35.051929 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.051882 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zh48p" podStartSLOduration=2.452537712 podStartE2EDuration="5.051866751s" totalImagesPullingTime="2.599329039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:06:35.050527605 +0000 UTC m=+299.070917706" watchObservedRunningTime="2026-07-22 12:06:35.051866751 +0000 UTC m=+299.072256852" Jul 22 12:06:35.185551 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.185523 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:35.286467 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.286404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util\") pod \"7da63ddf-db3c-41df-b36b-51b853a9839c\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " Jul 22 12:06:35.286467 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.286462 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle\") pod \"7da63ddf-db3c-41df-b36b-51b853a9839c\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " Jul 22 12:06:35.286604 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.286494 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l5js\" (UniqueName: \"kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js\") pod \"7da63ddf-db3c-41df-b36b-51b853a9839c\" (UID: \"7da63ddf-db3c-41df-b36b-51b853a9839c\") " Jul 22 12:06:35.286789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.286769 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle" (OuterVolumeSpecName: "bundle") pod "7da63ddf-db3c-41df-b36b-51b853a9839c" (UID: "7da63ddf-db3c-41df-b36b-51b853a9839c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:35.288513 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.288489 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js" (OuterVolumeSpecName: "kube-api-access-4l5js") pod "7da63ddf-db3c-41df-b36b-51b853a9839c" (UID: "7da63ddf-db3c-41df-b36b-51b853a9839c"). InnerVolumeSpecName "kube-api-access-4l5js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:06:35.290707 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.290673 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util" (OuterVolumeSpecName: "util") pod "7da63ddf-db3c-41df-b36b-51b853a9839c" (UID: "7da63ddf-db3c-41df-b36b-51b853a9839c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:35.387549 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.387523 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:35.387549 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.387545 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da63ddf-db3c-41df-b36b-51b853a9839c-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:35.387681 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:35.387554 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l5js\" (UniqueName: \"kubernetes.io/projected/7da63ddf-db3c-41df-b36b-51b853a9839c-kube-api-access-4l5js\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:36.041486 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.041463 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" Jul 22 12:06:36.041486 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.041474 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq98bj" event={"ID":"7da63ddf-db3c-41df-b36b-51b853a9839c","Type":"ContainerDied","Data":"cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89"} Jul 22 12:06:36.041865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.041513 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf8f8b8ec6a97c771dc52ba46c1de3530aff0a34c0d439c3820a65d49fda6b89" Jul 22 12:06:36.423422 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.423355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:06:36.427612 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.427588 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:06:36.435369 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:36.435341 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 12:06:39.141841 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.141805 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4qn6n"] Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142145 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="util" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142157 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="util" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142171 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="extract" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142176 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="extract" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142192 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="pull" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142197 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="pull" Jul 22 12:06:39.145234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.142254 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da63ddf-db3c-41df-b36b-51b853a9839c" containerName="extract" Jul 22 12:06:39.146470 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.146455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.149083 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.149055 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wvx27\"" Jul 22 12:06:39.158654 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.158631 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4qn6n"] Jul 22 12:06:39.217569 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.217525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27s56\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-kube-api-access-27s56\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.217742 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.217662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-bound-sa-token\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.318314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.318275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27s56\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-kube-api-access-27s56\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.318503 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.318356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-bound-sa-token\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.328278 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.328244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-bound-sa-token\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.328458 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.328438 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27s56\" (UniqueName: \"kubernetes.io/projected/1dcebd1c-e664-453f-93f6-e1847d7be291-kube-api-access-27s56\") pod \"cert-manager-55b4d954d5-4qn6n\" (UID: \"1dcebd1c-e664-453f-93f6-e1847d7be291\") " pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.455563 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.455472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4qn6n" Jul 22 12:06:39.593158 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:39.593131 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4qn6n"] Jul 22 12:06:39.596210 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:39.596180 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dcebd1c_e664_453f_93f6_e1847d7be291.slice/crio-b712c38be75a7482b3c1e13a87e8eda50fc71f211b3604ef22be207b8f84875f WatchSource:0}: Error finding container b712c38be75a7482b3c1e13a87e8eda50fc71f211b3604ef22be207b8f84875f: Status 404 returned error can't find the container with id b712c38be75a7482b3c1e13a87e8eda50fc71f211b3604ef22be207b8f84875f Jul 22 12:06:40.060905 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:40.060871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4qn6n" event={"ID":"1dcebd1c-e664-453f-93f6-e1847d7be291","Type":"ContainerStarted","Data":"6b5223b0f9f74965925e2979463272f64b271386e6a2155dd34edc4eb32d16a8"} Jul 22 12:06:40.061036 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:40.060915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4qn6n" event={"ID":"1dcebd1c-e664-453f-93f6-e1847d7be291","Type":"ContainerStarted","Data":"b712c38be75a7482b3c1e13a87e8eda50fc71f211b3604ef22be207b8f84875f"} Jul 22 12:06:40.079428 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:40.079387 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4qn6n" podStartSLOduration=1.079372519 podStartE2EDuration="1.079372519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:06:40.078655678 +0000 UTC m=+304.099045783" watchObservedRunningTime="2026-07-22 12:06:40.079372519 +0000 UTC m=+304.099762620" Jul 22 12:06:41.733190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.733156 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd"] Jul 22 12:06:41.736779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.736763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.741494 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.741474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:06:41.742083 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.742059 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 12:06:41.742083 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.742068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zcf7m\"" Jul 22 12:06:41.746049 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.746015 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd"] Jul 22 12:06:41.836677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.836651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbbr\" (UniqueName: \"kubernetes.io/projected/de219c42-4ec4-485b-b58b-d7aeff3265e5-kube-api-access-mgbbr\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.836787 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.836705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de219c42-4ec4-485b-b58b-d7aeff3265e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.937699 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.937677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de219c42-4ec4-485b-b58b-d7aeff3265e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.937786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.937721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbbr\" (UniqueName: \"kubernetes.io/projected/de219c42-4ec4-485b-b58b-d7aeff3265e5-kube-api-access-mgbbr\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.938065 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.938022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de219c42-4ec4-485b-b58b-d7aeff3265e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:41.952118 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:41.952094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbbr\" (UniqueName: \"kubernetes.io/projected/de219c42-4ec4-485b-b58b-d7aeff3265e5-kube-api-access-mgbbr\") pod \"openshift-lws-operator-fd8ccff4c-s84gd\" (UID: \"de219c42-4ec4-485b-b58b-d7aeff3265e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:42.046519 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:42.046498 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" Jul 22 12:06:42.171133 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:42.171102 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd"] Jul 22 12:06:42.174070 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:42.174032 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde219c42_4ec4_485b_b58b_d7aeff3265e5.slice/crio-69f8d47d14570a189755cb8d62991e6a74f0aa01bd910737cd9dab279df40b3e WatchSource:0}: Error finding container 69f8d47d14570a189755cb8d62991e6a74f0aa01bd910737cd9dab279df40b3e: Status 404 returned error can't find the container with id 69f8d47d14570a189755cb8d62991e6a74f0aa01bd910737cd9dab279df40b3e Jul 22 12:06:42.175581 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:42.175558 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:06:43.082262 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:43.082229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" event={"ID":"de219c42-4ec4-485b-b58b-d7aeff3265e5","Type":"ContainerStarted","Data":"69f8d47d14570a189755cb8d62991e6a74f0aa01bd910737cd9dab279df40b3e"} Jul 22 12:06:46.098302 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:46.098270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" event={"ID":"de219c42-4ec4-485b-b58b-d7aeff3265e5","Type":"ContainerStarted","Data":"99c2846eb6169d38ff0e98eb4f130e5861b5492f5032bffe68c17584da6e3e49"} Jul 22 12:06:46.149193 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:46.149145 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s84gd" podStartSLOduration=2.330252799 podStartE2EDuration="5.149130619s" totalImagesPullingTime="2.81887782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:06:46.148165737 +0000 UTC m=+310.168555839" watchObservedRunningTime="2026-07-22 12:06:46.149130619 +0000 UTC m=+310.169520721" Jul 22 12:06:48.841372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.841338 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w"] Jul 22 12:06:48.844008 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.843991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:48.846517 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.846497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:06:48.846622 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.846541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nk6xp\"" Jul 22 12:06:48.847184 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.847166 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:06:48.855789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.855769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w"] Jul 22 12:06:48.991438 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.991415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:48.991537 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.991487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhrz\" (UniqueName: \"kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:48.991537 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:48.991532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.092582 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.092532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhrz\" (UniqueName: \"kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.092582 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.092572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.092713 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.092603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.092957 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.092939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.092995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.092957 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.104795 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.104772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhrz\" (UniqueName: \"kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.153562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.153542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:49.302599 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:49.302567 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w"] Jul 22 12:06:49.307814 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:06:49.307779 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79093508_8062_4299_9df4_5b1e14be225c.slice/crio-b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282 WatchSource:0}: Error finding container b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282: Status 404 returned error can't find the container with id b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282 Jul 22 12:06:50.119898 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:50.119873 2564 generic.go:356] "Generic (PLEG): container finished" podID="79093508-8062-4299-9df4-5b1e14be225c" containerID="019f4bd43352d331cce293497b0fa64f1b8dfba4060916ae793176b71cd6552c" exitCode=0 Jul 22 12:06:50.120245 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:50.119936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" event={"ID":"79093508-8062-4299-9df4-5b1e14be225c","Type":"ContainerDied","Data":"019f4bd43352d331cce293497b0fa64f1b8dfba4060916ae793176b71cd6552c"} Jul 22 12:06:50.120245 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:50.119981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" event={"ID":"79093508-8062-4299-9df4-5b1e14be225c","Type":"ContainerStarted","Data":"b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282"} Jul 22 12:06:51.125532 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:51.125462 2564 generic.go:356] "Generic (PLEG): container finished" podID="79093508-8062-4299-9df4-5b1e14be225c" containerID="acba926765fb4b065827846da97819f21d972ecf1c6f43985f4c64615fd32948" exitCode=0 Jul 22 12:06:51.125925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:51.125545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" event={"ID":"79093508-8062-4299-9df4-5b1e14be225c","Type":"ContainerDied","Data":"acba926765fb4b065827846da97819f21d972ecf1c6f43985f4c64615fd32948"} Jul 22 12:06:52.132814 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:52.132780 2564 generic.go:356] "Generic (PLEG): container finished" podID="79093508-8062-4299-9df4-5b1e14be225c" containerID="ea69fa2477052739d2b75ed7047d7f05e049fe0a3fab767f71470fea58821c5b" exitCode=0 Jul 22 12:06:52.133225 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:52.132840 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" event={"ID":"79093508-8062-4299-9df4-5b1e14be225c","Type":"ContainerDied","Data":"ea69fa2477052739d2b75ed7047d7f05e049fe0a3fab767f71470fea58821c5b"} Jul 22 12:06:53.258566 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.258543 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:06:53.328520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.328491 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util\") pod \"79093508-8062-4299-9df4-5b1e14be225c\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " Jul 22 12:06:53.328650 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.328549 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle\") pod \"79093508-8062-4299-9df4-5b1e14be225c\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " Jul 22 12:06:53.328650 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.328582 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlhrz\" (UniqueName: \"kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz\") pod \"79093508-8062-4299-9df4-5b1e14be225c\" (UID: \"79093508-8062-4299-9df4-5b1e14be225c\") " Jul 22 12:06:53.329197 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.329176 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle" (OuterVolumeSpecName: "bundle") pod "79093508-8062-4299-9df4-5b1e14be225c" (UID: "79093508-8062-4299-9df4-5b1e14be225c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:53.330478 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.330458 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz" (OuterVolumeSpecName: "kube-api-access-zlhrz") pod "79093508-8062-4299-9df4-5b1e14be225c" (UID: "79093508-8062-4299-9df4-5b1e14be225c"). InnerVolumeSpecName "kube-api-access-zlhrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:06:53.333729 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.333704 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util" (OuterVolumeSpecName: "util") pod "79093508-8062-4299-9df4-5b1e14be225c" (UID: "79093508-8062-4299-9df4-5b1e14be225c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:06:53.429772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.429726 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:53.429772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.429745 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlhrz\" (UniqueName: \"kubernetes.io/projected/79093508-8062-4299-9df4-5b1e14be225c-kube-api-access-zlhrz\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:53.429772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:53.429754 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79093508-8062-4299-9df4-5b1e14be225c-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:06:54.143935 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:54.143905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" event={"ID":"79093508-8062-4299-9df4-5b1e14be225c","Type":"ContainerDied","Data":"b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282"} Jul 22 12:06:54.144119 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:54.143969 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b378fc5da6a97a5def353dfac9d7700b13bc0698c0c893babfc81dc3a436f282" Jul 22 12:06:54.144119 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:06:54.143915 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp92w" Jul 22 12:07:03.421842 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.421810 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m"] Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422148 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="util" Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422161 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="util" Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422168 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="pull" Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422174 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="pull" Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422180 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="extract" Jul 22 12:07:03.422209 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422185 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="extract" Jul 22 12:07:03.422391 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.422247 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="79093508-8062-4299-9df4-5b1e14be225c" containerName="extract" Jul 22 12:07:03.424360 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.424343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.427959 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.427939 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 12:07:03.428081 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.427939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 12:07:03.429574 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.429554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 12:07:03.429574 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.429569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 12:07:03.433627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.433609 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-47874\"" Jul 22 12:07:03.456851 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.456831 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m"] Jul 22 12:07:03.503778 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.503756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-tmp\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.503885 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.503786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-manifests\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.503885 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.503804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqxv\" (UniqueName: \"kubernetes.io/projected/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-kube-api-access-hkqxv\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.503885 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.503829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.504007 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.503915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.604567 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.604544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.604657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.604596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.604657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.604635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-tmp\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.604657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.604653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-manifests\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.604816 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.604673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqxv\" (UniqueName: \"kubernetes.io/projected/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-kube-api-access-hkqxv\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.605127 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.605087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-manifests\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.606711 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.606685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-tmp\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.606921 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.606905 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.606965 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.606939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.615925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.615907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqxv\" (UniqueName: \"kubernetes.io/projected/6a2b2d98-eaee-4141-a277-3a8c6b74e8b7-kube-api-access-hkqxv\") pod \"opendatahub-operator-controller-manager-979495d87-thg7m\" (UID: \"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7\") " pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.734557 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.734503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:03.869392 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:03.869356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m"] Jul 22 12:07:03.871138 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:07:03.871110 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2b2d98_eaee_4141_a277_3a8c6b74e8b7.slice/crio-d14cbd326c97d1bf3ac0368b8fe51005f6855412192c6626e35ba936b0c4ab95 WatchSource:0}: Error finding container d14cbd326c97d1bf3ac0368b8fe51005f6855412192c6626e35ba936b0c4ab95: Status 404 returned error can't find the container with id d14cbd326c97d1bf3ac0368b8fe51005f6855412192c6626e35ba936b0c4ab95 Jul 22 12:07:04.192643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:04.192594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" event={"ID":"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7","Type":"ContainerStarted","Data":"d14cbd326c97d1bf3ac0368b8fe51005f6855412192c6626e35ba936b0c4ab95"} Jul 22 12:07:07.209438 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:07.209402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" event={"ID":"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7","Type":"ContainerStarted","Data":"27fe85768501e45021727fa98bae4a5b73804ed1962e06331604dd067d71c18a"} Jul 22 12:07:08.215273 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:08.215239 2564 generic.go:356] "Generic (PLEG): container finished" podID="6a2b2d98-eaee-4141-a277-3a8c6b74e8b7" containerID="27fe85768501e45021727fa98bae4a5b73804ed1962e06331604dd067d71c18a" exitCode=0 Jul 22 12:07:08.215600 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:08.215320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" event={"ID":"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7","Type":"ContainerDied","Data":"27fe85768501e45021727fa98bae4a5b73804ed1962e06331604dd067d71c18a"} Jul 22 12:07:09.222414 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:09.222380 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" event={"ID":"6a2b2d98-eaee-4141-a277-3a8c6b74e8b7","Type":"ContainerStarted","Data":"7be2137119ee401c0154abd7e3c9ba5800a22ceee5b0c6e3067359a51238f4e8"} Jul 22 12:07:09.222787 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:09.222474 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:09.245364 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:09.245318 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" podStartSLOduration=2.120509807 podStartE2EDuration="6.245304362s" totalImagesPullingTime="3.094677915s" totalInitContainerRuntime="1.03011664s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:07:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:07:09.244008974 +0000 UTC m=+333.264399076" watchObservedRunningTime="2026-07-22 12:07:09.245304362 +0000 UTC m=+333.265694463" Jul 22 12:07:20.229736 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:20.229706 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-979495d87-thg7m" Jul 22 12:07:30.242505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.242428 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw"] Jul 22 12:07:30.245530 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.245510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.251216 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.251190 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 12:07:30.251315 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.251197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 12:07:30.252120 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.252098 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p5pj9\"" Jul 22 12:07:30.252297 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.252275 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 12:07:30.252618 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.252585 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 12:07:30.258465 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.258442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw"] Jul 22 12:07:30.325660 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.325632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934cf675-5924-4b97-9905-aeab401309ae-tls-certs\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.325766 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.325683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csv8m\" (UniqueName: \"kubernetes.io/projected/934cf675-5924-4b97-9905-aeab401309ae-kube-api-access-csv8m\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.325766 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.325752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/934cf675-5924-4b97-9905-aeab401309ae-tmp\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.427059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.427018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934cf675-5924-4b97-9905-aeab401309ae-tls-certs\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.427161 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.427075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csv8m\" (UniqueName: \"kubernetes.io/projected/934cf675-5924-4b97-9905-aeab401309ae-kube-api-access-csv8m\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.427161 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.427115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/934cf675-5924-4b97-9905-aeab401309ae-tmp\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.429365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.429337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/934cf675-5924-4b97-9905-aeab401309ae-tmp\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.429553 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.429531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934cf675-5924-4b97-9905-aeab401309ae-tls-certs\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.436836 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.436813 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csv8m\" (UniqueName: \"kubernetes.io/projected/934cf675-5924-4b97-9905-aeab401309ae-kube-api-access-csv8m\") pod \"kube-auth-proxy-f68f699cd-g2qcw\" (UID: \"934cf675-5924-4b97-9905-aeab401309ae\") " pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.555342 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.555314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" Jul 22 12:07:30.694002 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:30.693968 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw"] Jul 22 12:07:30.697760 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:07:30.697722 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934cf675_5924_4b97_9905_aeab401309ae.slice/crio-d02ecb26cb45b97008267e645652db4b624fc7bd715037509c3782ea317b674a WatchSource:0}: Error finding container d02ecb26cb45b97008267e645652db4b624fc7bd715037509c3782ea317b674a: Status 404 returned error can't find the container with id d02ecb26cb45b97008267e645652db4b624fc7bd715037509c3782ea317b674a Jul 22 12:07:31.332994 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:31.332961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" event={"ID":"934cf675-5924-4b97-9905-aeab401309ae","Type":"ContainerStarted","Data":"d02ecb26cb45b97008267e645652db4b624fc7bd715037509c3782ea317b674a"} Jul 22 12:07:34.352547 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:34.352506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" event={"ID":"934cf675-5924-4b97-9905-aeab401309ae","Type":"ContainerStarted","Data":"186fdb2f12b68982b254928778442027fa999950fcac9c6a1f8feab082660dbb"} Jul 22 12:07:34.376232 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:34.376178 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f68f699cd-g2qcw" podStartSLOduration=1.575074138 podStartE2EDuration="4.376160262s" totalImagesPullingTime="2.801086124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:07:34.375681931 +0000 UTC m=+358.396072035" watchObservedRunningTime="2026-07-22 12:07:34.376160262 +0000 UTC m=+358.396550364" Jul 22 12:07:35.641106 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.641076 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6"] Jul 22 12:07:35.647334 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.647315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.654636 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.654613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 12:07:35.655394 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.655379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 12:07:35.655482 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.655408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 12:07:35.659880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.659864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-svdmj\"" Jul 22 12:07:35.665339 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.665318 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6"] Jul 22 12:07:35.675906 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.675881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kx25\" (UniqueName: \"kubernetes.io/projected/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-kube-api-access-4kx25\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.676013 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.675997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.676117 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.676098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-manager-config\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.676170 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.676131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-metrics-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.777520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.777485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.777649 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.777536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-manager-config\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.777649 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.777559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-metrics-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.777649 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.777614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kx25\" (UniqueName: \"kubernetes.io/projected/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-kube-api-access-4kx25\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.778274 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.778251 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-manager-config\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.779957 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.779940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-metrics-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.780025 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.779951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-cert\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.798524 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.798503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kx25\" (UniqueName: \"kubernetes.io/projected/b8f420e8-121f-4c0e-bc0d-4d4b40683bfd-kube-api-access-4kx25\") pod \"lws-controller-manager-5fc976ff6d-4bss6\" (UID: \"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd\") " pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:35.956699 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:35.956636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:36.131572 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:36.131544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6"] Jul 22 12:07:36.136325 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:07:36.136287 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f420e8_121f_4c0e_bc0d_4d4b40683bfd.slice/crio-a50bfb91ea5d71e967e90928d947d3bde9cc040cfcd03a2dac7d9c7e0d5617cc WatchSource:0}: Error finding container a50bfb91ea5d71e967e90928d947d3bde9cc040cfcd03a2dac7d9c7e0d5617cc: Status 404 returned error can't find the container with id a50bfb91ea5d71e967e90928d947d3bde9cc040cfcd03a2dac7d9c7e0d5617cc Jul 22 12:07:36.363556 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:36.363520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" event={"ID":"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd","Type":"ContainerStarted","Data":"a50bfb91ea5d71e967e90928d947d3bde9cc040cfcd03a2dac7d9c7e0d5617cc"} Jul 22 12:07:38.376555 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:38.376522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" event={"ID":"b8f420e8-121f-4c0e-bc0d-4d4b40683bfd","Type":"ContainerStarted","Data":"7b560174a591c28403261c334e2ef5b773b8163fe8914415c40a42c602202d54"} Jul 22 12:07:38.376953 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:38.376589 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:07:38.411232 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:38.411190 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" podStartSLOduration=1.73148155 podStartE2EDuration="3.411175985s" totalImagesPullingTime="1.679694435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:07:38.409723518 +0000 UTC m=+362.430113619" watchObservedRunningTime="2026-07-22 12:07:38.411175985 +0000 UTC m=+362.431566086" Jul 22 12:07:49.385562 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:07:49.385532 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fc976ff6d-4bss6" Jul 22 12:08:41.681447 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.681417 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq"] Jul 22 12:08:41.685059 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.685023 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.688509 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.688488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 12:08:41.689751 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.689733 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 12:08:41.689822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.689755 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l7xw8\"" Jul 22 12:08:41.697159 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.697136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq"] Jul 22 12:08:41.782559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.782539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.782653 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.782566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.782653 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.782594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggbm\" (UniqueName: \"kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.883842 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.883820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggbm\" (UniqueName: \"kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.883923 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.883889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.883923 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.883906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.884216 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.884202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.884264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.884237 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.894333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.894316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggbm\" (UniqueName: \"kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:41.994628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:41.994572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:42.128533 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.128497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq"] Jul 22 12:08:42.131498 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:08:42.131471 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f5cfd7_36bf_4765_93c8_d2c6663854ce.slice/crio-8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40 WatchSource:0}: Error finding container 8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40: Status 404 returned error can't find the container with id 8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40 Jul 22 12:08:42.508939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.508908 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg"] Jul 22 12:08:42.512759 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.512742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.538182 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.538159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg"] Jul 22 12:08:42.589056 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.589017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.589143 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.589118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crvsj\" (UniqueName: \"kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.589190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.589157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.690459 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.690437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.690808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.690484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crvsj\" (UniqueName: \"kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.690808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.690509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.690808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.690758 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.690808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.690777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.700791 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.700766 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerID="b26e3d5824d38846d8aeedb2ca9bc2a044eb100d5281d1ca878f04c78f42a301" exitCode=0 Jul 22 12:08:42.700874 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.700832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" event={"ID":"d2f5cfd7-36bf-4765-93c8-d2c6663854ce","Type":"ContainerDied","Data":"b26e3d5824d38846d8aeedb2ca9bc2a044eb100d5281d1ca878f04c78f42a301"} Jul 22 12:08:42.700874 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.700860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" event={"ID":"d2f5cfd7-36bf-4765-93c8-d2c6663854ce","Type":"ContainerStarted","Data":"8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40"} Jul 22 12:08:42.704013 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.703994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crvsj\" (UniqueName: \"kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.821123 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.821091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:42.959370 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:42.959341 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg"] Jul 22 12:08:42.961543 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:08:42.961516 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ce7331_8557_4259_b265_bd274561ee0a.slice/crio-41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07 WatchSource:0}: Error finding container 41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07: Status 404 returned error can't find the container with id 41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07 Jul 22 12:08:43.290880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.290852 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp"] Jul 22 12:08:43.294656 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.294634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.311528 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.311507 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp"] Jul 22 12:08:43.396328 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.396300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.396459 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.396337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.396459 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.396412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbth\" (UniqueName: \"kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.497827 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.497796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbth\" (UniqueName: \"kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.497983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.497841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.497983 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.497869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.498293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.498266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.498333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.498296 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.507839 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.507817 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbth\" (UniqueName: \"kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.603882 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.603860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:43.708810 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.708777 2564 generic.go:356] "Generic (PLEG): container finished" podID="27ce7331-8557-4259-b265-bd274561ee0a" containerID="081cac62878e2793570198b62d2eef50038db1bf170269ed04d6b4863e509049" exitCode=0 Jul 22 12:08:43.709195 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.708811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" event={"ID":"27ce7331-8557-4259-b265-bd274561ee0a","Type":"ContainerDied","Data":"081cac62878e2793570198b62d2eef50038db1bf170269ed04d6b4863e509049"} Jul 22 12:08:43.709195 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.708860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" event={"ID":"27ce7331-8557-4259-b265-bd274561ee0a","Type":"ContainerStarted","Data":"41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07"} Jul 22 12:08:43.711104 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.711080 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerID="959551b5ab49b8c1ac1c9ad600e13dd698bbce889aeacd9d703cd45f01a4255e" exitCode=0 Jul 22 12:08:43.711200 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.711159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" event={"ID":"d2f5cfd7-36bf-4765-93c8-d2c6663854ce","Type":"ContainerDied","Data":"959551b5ab49b8c1ac1c9ad600e13dd698bbce889aeacd9d703cd45f01a4255e"} Jul 22 12:08:43.744721 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.744692 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp"] Jul 22 12:08:43.748649 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:08:43.748621 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e3c5d5_d784_41bb_807e_7e9257ea45a3.slice/crio-6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e WatchSource:0}: Error finding container 6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e: Status 404 returned error can't find the container with id 6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e Jul 22 12:08:43.874072 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.874029 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp"] Jul 22 12:08:43.877702 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.877687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:43.896220 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:43.896193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp"] Jul 22 12:08:44.002315 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.002287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.002437 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.002361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.002437 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.002390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhfh8\" (UniqueName: \"kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.103475 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.103442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.103560 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.103501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.103560 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.103521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhfh8\" (UniqueName: \"kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.103806 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.103788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.103882 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.103838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.116308 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.116283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhfh8\" (UniqueName: \"kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.240912 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.240863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:44.378790 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:08:44.378750 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9540337c_08f2_492d_b981_c7b237691323.slice/crio-e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0 WatchSource:0}: Error finding container e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0: Status 404 returned error can't find the container with id e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0 Jul 22 12:08:44.380240 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.380199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp"] Jul 22 12:08:44.717626 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.717598 2564 generic.go:356] "Generic (PLEG): container finished" podID="9540337c-08f2-492d-b981-c7b237691323" containerID="8eb3fd568bb85dbde3e6a2e4a1c7dd471257813fdca792feff8ca4231742c9c8" exitCode=0 Jul 22 12:08:44.718005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.717669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" event={"ID":"9540337c-08f2-492d-b981-c7b237691323","Type":"ContainerDied","Data":"8eb3fd568bb85dbde3e6a2e4a1c7dd471257813fdca792feff8ca4231742c9c8"} Jul 22 12:08:44.718005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.717705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" event={"ID":"9540337c-08f2-492d-b981-c7b237691323","Type":"ContainerStarted","Data":"e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0"} Jul 22 12:08:44.719264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.719241 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerID="1314d6c1e429d9120ad0c256ebe74f7841debfdee155d2bf4553266c4bf31ce2" exitCode=0 Jul 22 12:08:44.719365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.719319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" event={"ID":"b2e3c5d5-d784-41bb-807e-7e9257ea45a3","Type":"ContainerDied","Data":"1314d6c1e429d9120ad0c256ebe74f7841debfdee155d2bf4553266c4bf31ce2"} Jul 22 12:08:44.719365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.719355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" event={"ID":"b2e3c5d5-d784-41bb-807e-7e9257ea45a3","Type":"ContainerStarted","Data":"6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e"} Jul 22 12:08:44.721642 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.721622 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerID="85d414795edfe84e78885fd22311d1e6d8aa37e130b79c67a5b29390e2f078d9" exitCode=0 Jul 22 12:08:44.721742 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:44.721652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" event={"ID":"d2f5cfd7-36bf-4765-93c8-d2c6663854ce","Type":"ContainerDied","Data":"85d414795edfe84e78885fd22311d1e6d8aa37e130b79c67a5b29390e2f078d9"} Jul 22 12:08:45.728744 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.728667 2564 generic.go:356] "Generic (PLEG): container finished" podID="9540337c-08f2-492d-b981-c7b237691323" containerID="6965108a9f7094a1e955bdefabdd51868570e75eb78bdf2f760b2dd5707581bb" exitCode=0 Jul 22 12:08:45.729103 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.728747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" event={"ID":"9540337c-08f2-492d-b981-c7b237691323","Type":"ContainerDied","Data":"6965108a9f7094a1e955bdefabdd51868570e75eb78bdf2f760b2dd5707581bb"} Jul 22 12:08:45.855686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.855664 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:45.918916 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.918893 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hggbm\" (UniqueName: \"kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm\") pod \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " Jul 22 12:08:45.919106 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.919087 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle\") pod \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " Jul 22 12:08:45.919172 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.919128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util\") pod \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\" (UID: \"d2f5cfd7-36bf-4765-93c8-d2c6663854ce\") " Jul 22 12:08:45.919566 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.919532 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle" (OuterVolumeSpecName: "bundle") pod "d2f5cfd7-36bf-4765-93c8-d2c6663854ce" (UID: "d2f5cfd7-36bf-4765-93c8-d2c6663854ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:45.920951 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.920930 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm" (OuterVolumeSpecName: "kube-api-access-hggbm") pod "d2f5cfd7-36bf-4765-93c8-d2c6663854ce" (UID: "d2f5cfd7-36bf-4765-93c8-d2c6663854ce"). InnerVolumeSpecName "kube-api-access-hggbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:08:45.924421 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:45.924387 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util" (OuterVolumeSpecName: "util") pod "d2f5cfd7-36bf-4765-93c8-d2c6663854ce" (UID: "d2f5cfd7-36bf-4765-93c8-d2c6663854ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:46.020804 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.020736 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:46.020804 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.020770 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:46.020804 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.020785 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hggbm\" (UniqueName: \"kubernetes.io/projected/d2f5cfd7-36bf-4765-93c8-d2c6663854ce-kube-api-access-hggbm\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:46.734693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.734670 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" Jul 22 12:08:46.735033 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.734753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq" event={"ID":"d2f5cfd7-36bf-4765-93c8-d2c6663854ce","Type":"ContainerDied","Data":"8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40"} Jul 22 12:08:46.735033 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.734801 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fcb5e157f87f73eaa5bd26a7835b8a879796c134cb0a67c5c541dde6bfa0e40" Jul 22 12:08:46.736997 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.736970 2564 generic.go:356] "Generic (PLEG): container finished" podID="9540337c-08f2-492d-b981-c7b237691323" containerID="f6dbcc5d576d0313cc9ca4157851844156f64e636bf4b5630ed1d0d449504e2c" exitCode=0 Jul 22 12:08:46.737123 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.737001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" event={"ID":"9540337c-08f2-492d-b981-c7b237691323","Type":"ContainerDied","Data":"f6dbcc5d576d0313cc9ca4157851844156f64e636bf4b5630ed1d0d449504e2c"} Jul 22 12:08:46.738656 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.738636 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerID="87aa24e98c7a52dc33eebd9f951f2f2ec64f93d4369cf9f10ba2778b5caf374a" exitCode=0 Jul 22 12:08:46.738736 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:46.738662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" event={"ID":"b2e3c5d5-d784-41bb-807e-7e9257ea45a3","Type":"ContainerDied","Data":"87aa24e98c7a52dc33eebd9f951f2f2ec64f93d4369cf9f10ba2778b5caf374a"} Jul 22 12:08:47.746515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.746454 2564 generic.go:356] "Generic (PLEG): container finished" podID="27ce7331-8557-4259-b265-bd274561ee0a" containerID="6c87a79dbbf90b74ee6f31bcb14b526881b98ee0e99c6d089a9e68b8767ed648" exitCode=0 Jul 22 12:08:47.746515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.746484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" event={"ID":"27ce7331-8557-4259-b265-bd274561ee0a","Type":"ContainerDied","Data":"6c87a79dbbf90b74ee6f31bcb14b526881b98ee0e99c6d089a9e68b8767ed648"} Jul 22 12:08:47.748719 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.748692 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerID="43297f1afb663f064f23e161a32166ade44e2b76801635d86e120ac6a0a0f38a" exitCode=0 Jul 22 12:08:47.748802 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.748768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" event={"ID":"b2e3c5d5-d784-41bb-807e-7e9257ea45a3","Type":"ContainerDied","Data":"43297f1afb663f064f23e161a32166ade44e2b76801635d86e120ac6a0a0f38a"} Jul 22 12:08:47.890254 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.890229 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:47.935112 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.935088 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhfh8\" (UniqueName: \"kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8\") pod \"9540337c-08f2-492d-b981-c7b237691323\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " Jul 22 12:08:47.935246 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.935191 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util\") pod \"9540337c-08f2-492d-b981-c7b237691323\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " Jul 22 12:08:47.935246 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.935226 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle\") pod \"9540337c-08f2-492d-b981-c7b237691323\" (UID: \"9540337c-08f2-492d-b981-c7b237691323\") " Jul 22 12:08:47.935936 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.935869 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle" (OuterVolumeSpecName: "bundle") pod "9540337c-08f2-492d-b981-c7b237691323" (UID: "9540337c-08f2-492d-b981-c7b237691323"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:47.943841 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.943814 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util" (OuterVolumeSpecName: "util") pod "9540337c-08f2-492d-b981-c7b237691323" (UID: "9540337c-08f2-492d-b981-c7b237691323"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:47.948318 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:47.948297 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8" (OuterVolumeSpecName: "kube-api-access-hhfh8") pod "9540337c-08f2-492d-b981-c7b237691323" (UID: "9540337c-08f2-492d-b981-c7b237691323"). InnerVolumeSpecName "kube-api-access-hhfh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:08:48.036321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.036299 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhfh8\" (UniqueName: \"kubernetes.io/projected/9540337c-08f2-492d-b981-c7b237691323-kube-api-access-hhfh8\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:48.036321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.036320 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:48.036440 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.036329 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540337c-08f2-492d-b981-c7b237691323-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:48.755293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.755264 2564 generic.go:356] "Generic (PLEG): container finished" podID="27ce7331-8557-4259-b265-bd274561ee0a" containerID="ec22d39895402c496a902a2741a1ab94c20a86f203ab0030700e5ea526f7197a" exitCode=0 Jul 22 12:08:48.755631 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.755332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" event={"ID":"27ce7331-8557-4259-b265-bd274561ee0a","Type":"ContainerDied","Data":"ec22d39895402c496a902a2741a1ab94c20a86f203ab0030700e5ea526f7197a"} Jul 22 12:08:48.757110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.757093 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" Jul 22 12:08:48.757201 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.757128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp" event={"ID":"9540337c-08f2-492d-b981-c7b237691323","Type":"ContainerDied","Data":"e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0"} Jul 22 12:08:48.757201 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.757174 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5859230a94c6f40f434977a2e4ce84c314829fad926b38019c8946adc93f1c0" Jul 22 12:08:48.877828 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.877809 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:48.944755 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.944732 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util\") pod \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " Jul 22 12:08:48.944875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.944764 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle\") pod \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " Jul 22 12:08:48.944875 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.944865 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wbth\" (UniqueName: \"kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth\") pod \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\" (UID: \"b2e3c5d5-d784-41bb-807e-7e9257ea45a3\") " Jul 22 12:08:48.945280 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.945256 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle" (OuterVolumeSpecName: "bundle") pod "b2e3c5d5-d784-41bb-807e-7e9257ea45a3" (UID: "b2e3c5d5-d784-41bb-807e-7e9257ea45a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:48.946802 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.946786 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth" (OuterVolumeSpecName: "kube-api-access-6wbth") pod "b2e3c5d5-d784-41bb-807e-7e9257ea45a3" (UID: "b2e3c5d5-d784-41bb-807e-7e9257ea45a3"). InnerVolumeSpecName "kube-api-access-6wbth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:08:48.950249 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:48.950222 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util" (OuterVolumeSpecName: "util") pod "b2e3c5d5-d784-41bb-807e-7e9257ea45a3" (UID: "b2e3c5d5-d784-41bb-807e-7e9257ea45a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:49.046008 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.045978 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wbth\" (UniqueName: \"kubernetes.io/projected/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-kube-api-access-6wbth\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:49.046128 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.046009 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:49.046128 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.046024 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2e3c5d5-d784-41bb-807e-7e9257ea45a3-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:49.763985 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.763958 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" Jul 22 12:08:49.764461 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.763956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp" event={"ID":"b2e3c5d5-d784-41bb-807e-7e9257ea45a3","Type":"ContainerDied","Data":"6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e"} Jul 22 12:08:49.764461 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.764093 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6090d6b95e80336f750a2a507a57f5506e1bd879ec3219dbfd88c0c10adbf43e" Jul 22 12:08:49.888791 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.888769 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:49.959051 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.959015 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle\") pod \"27ce7331-8557-4259-b265-bd274561ee0a\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " Jul 22 12:08:49.959163 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.959062 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crvsj\" (UniqueName: \"kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj\") pod \"27ce7331-8557-4259-b265-bd274561ee0a\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " Jul 22 12:08:49.959163 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.959095 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util\") pod \"27ce7331-8557-4259-b265-bd274561ee0a\" (UID: \"27ce7331-8557-4259-b265-bd274561ee0a\") " Jul 22 12:08:49.959639 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.959618 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle" (OuterVolumeSpecName: "bundle") pod "27ce7331-8557-4259-b265-bd274561ee0a" (UID: "27ce7331-8557-4259-b265-bd274561ee0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:49.961030 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.961008 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj" (OuterVolumeSpecName: "kube-api-access-crvsj") pod "27ce7331-8557-4259-b265-bd274561ee0a" (UID: "27ce7331-8557-4259-b265-bd274561ee0a"). InnerVolumeSpecName "kube-api-access-crvsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:08:49.963423 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:49.963402 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util" (OuterVolumeSpecName: "util") pod "27ce7331-8557-4259-b265-bd274561ee0a" (UID: "27ce7331-8557-4259-b265-bd274561ee0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:08:50.060728 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.060704 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:50.060728 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.060726 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crvsj\" (UniqueName: \"kubernetes.io/projected/27ce7331-8557-4259-b265-bd274561ee0a-kube-api-access-crvsj\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:50.060851 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.060740 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ce7331-8557-4259-b265-bd274561ee0a-util\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:08:50.770439 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.770416 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" Jul 22 12:08:50.770750 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.770443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg" event={"ID":"27ce7331-8557-4259-b265-bd274561ee0a","Type":"ContainerDied","Data":"41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07"} Jul 22 12:08:50.770750 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:08:50.770482 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41fb61a6420b8f8f8a729c10b072b0c175655067f4369984c501473da69b6e07" Jul 22 12:09:12.302374 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302294 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7dc85f7b-fzjg7"] Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302745 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="util" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302763 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="util" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302777 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="pull" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302784 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="pull" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302796 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="extract" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302805 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="extract" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302816 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="extract" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302823 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="extract" Jul 22 12:09:12.302848 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302846 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302854 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302870 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302878 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302886 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302894 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302904 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302912 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302923 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302932 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302942 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302950 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302961 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302968 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="pull" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302977 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.302984 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="util" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.303082 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9540337c-08f2-492d-b981-c7b237691323" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.303095 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f5cfd7-36bf-4765-93c8-d2c6663854ce" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.303106 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ce7331-8557-4259-b265-bd274561ee0a" containerName="extract" Jul 22 12:09:12.303244 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.303116 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e3c5d5-d784-41bb-807e-7e9257ea45a3" containerName="extract" Jul 22 12:09:12.305965 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.305949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.378282 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.378253 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7dc85f7b-fzjg7"] Jul 22 12:09:12.427928 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.427906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-oauth-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428069 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.427939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-service-ca\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428069 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.427956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428069 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.427976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-oauth-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428069 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.428011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428215 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.428127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2pvn\" (UniqueName: \"kubernetes.io/projected/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-kube-api-access-k2pvn\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.428215 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.428160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-trusted-ca-bundle\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.528902 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.528879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-trusted-ca-bundle\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529015 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.528923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-oauth-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529015 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.528944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-service-ca\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529015 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.528959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529015 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.528977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-oauth-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2pvn\" (UniqueName: \"kubernetes.io/projected/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-kube-api-access-k2pvn\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529722 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-service-ca\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529801 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529779 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-oauth-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529839 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529823 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.529943 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.529920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-trusted-ca-bundle\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.531477 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.531450 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-oauth-config\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.531556 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.531527 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-console-serving-cert\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.543317 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.543300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2pvn\" (UniqueName: \"kubernetes.io/projected/d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc-kube-api-access-k2pvn\") pod \"console-5c7dc85f7b-fzjg7\" (UID: \"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc\") " pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.617206 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.617155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:12.770190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.770169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7dc85f7b-fzjg7"] Jul 22 12:09:12.771918 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:09:12.771894 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1768ab4_de25_4e5d_bd9f_cc0a3751e5bc.slice/crio-8d5c28d054ac5d9c6774de3c3268b586a4cb0b66f9d4f34c9d2919392fa70bbe WatchSource:0}: Error finding container 8d5c28d054ac5d9c6774de3c3268b586a4cb0b66f9d4f34c9d2919392fa70bbe: Status 404 returned error can't find the container with id 8d5c28d054ac5d9c6774de3c3268b586a4cb0b66f9d4f34c9d2919392fa70bbe Jul 22 12:09:12.885005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.884937 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dc85f7b-fzjg7" event={"ID":"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc","Type":"ContainerStarted","Data":"d0f43e6ecde6634633f47f1f615bcdeb8275fc8e037217b89f5ffeb3af097841"} Jul 22 12:09:12.885005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.884989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dc85f7b-fzjg7" event={"ID":"d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc","Type":"ContainerStarted","Data":"8d5c28d054ac5d9c6774de3c3268b586a4cb0b66f9d4f34c9d2919392fa70bbe"} Jul 22 12:09:12.917545 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:12.917499 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7dc85f7b-fzjg7" podStartSLOduration=0.917483897 podStartE2EDuration="917.483897ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:09:12.915192504 +0000 UTC m=+456.935582606" watchObservedRunningTime="2026-07-22 12:09:12.917483897 +0000 UTC m=+456.937873998" Jul 22 12:09:18.687762 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.687727 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2"] Jul 22 12:09:18.692852 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.692833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.695441 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.695421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 22 12:09:18.695556 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.695420 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 22 12:09:18.695615 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.695562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 12:09:18.696926 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.696904 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l7xw8\"" Jul 22 12:09:18.697017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.696928 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 12:09:18.704253 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.704232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2"] Jul 22 12:09:18.875819 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.875793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.875927 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.875823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b4ecdbe-2490-41c7-9535-3335f1a394e4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.875927 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.875865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4mj\" (UniqueName: \"kubernetes.io/projected/1b4ecdbe-2490-41c7-9535-3335f1a394e4-kube-api-access-6l4mj\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.976737 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.976680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4mj\" (UniqueName: \"kubernetes.io/projected/1b4ecdbe-2490-41c7-9535-3335f1a394e4-kube-api-access-6l4mj\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.976846 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.976740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.976846 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.976761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b4ecdbe-2490-41c7-9535-3335f1a394e4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.976964 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:09:18.976844 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 22 12:09:18.976964 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:09:18.976936 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert podName:1b4ecdbe-2490-41c7-9535-3335f1a394e4 nodeName:}" failed. No retries permitted until 2026-07-22 12:09:19.476914375 +0000 UTC m=+463.497304467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-98tb2" (UID: "1b4ecdbe-2490-41c7-9535-3335f1a394e4") : secret "plugin-serving-cert" not found Jul 22 12:09:18.977357 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.977341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b4ecdbe-2490-41c7-9535-3335f1a394e4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:18.987172 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:18.987152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4mj\" (UniqueName: \"kubernetes.io/projected/1b4ecdbe-2490-41c7-9535-3335f1a394e4-kube-api-access-6l4mj\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:19.480662 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:19.480634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:19.482895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:19.482877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b4ecdbe-2490-41c7-9535-3335f1a394e4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98tb2\" (UID: \"1b4ecdbe-2490-41c7-9535-3335f1a394e4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:19.603332 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:19.603306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" Jul 22 12:09:19.733308 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:19.733280 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2"] Jul 22 12:09:19.734645 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:09:19.734619 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b4ecdbe_2490_41c7_9535_3335f1a394e4.slice/crio-1ebc9d4fceb36e63c44bbee43a623e257ac60b12609aca6f60363be9fbe3c993 WatchSource:0}: Error finding container 1ebc9d4fceb36e63c44bbee43a623e257ac60b12609aca6f60363be9fbe3c993: Status 404 returned error can't find the container with id 1ebc9d4fceb36e63c44bbee43a623e257ac60b12609aca6f60363be9fbe3c993 Jul 22 12:09:19.923647 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:19.923617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" event={"ID":"1b4ecdbe-2490-41c7-9535-3335f1a394e4","Type":"ContainerStarted","Data":"1ebc9d4fceb36e63c44bbee43a623e257ac60b12609aca6f60363be9fbe3c993"} Jul 22 12:09:22.617456 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:22.617421 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:22.617894 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:22.617488 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:22.623733 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:22.623699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:22.950101 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:22.950014 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7dc85f7b-fzjg7" Jul 22 12:09:23.047559 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:23.047529 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:09:36.462085 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:36.462052 2564 scope.go:117] "RemoveContainer" containerID="f4acf7224d0845ce2175ba5bcc9be7bde0408b3836035441cc4672ee7b684ddd" Jul 22 12:09:42.068293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:42.068253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" event={"ID":"1b4ecdbe-2490-41c7-9535-3335f1a394e4","Type":"ContainerStarted","Data":"fc70df40c0de2fc23c376ac1353613ffe40d32a15555694317b3bc964cd4740d"} Jul 22 12:09:42.092310 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:42.092259 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98tb2" podStartSLOduration=2.574597193 podStartE2EDuration="24.092245172s" totalImagesPullingTime="21.517647979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:09:42.090933653 +0000 UTC m=+486.111323757" watchObservedRunningTime="2026-07-22 12:09:42.092245172 +0000 UTC m=+486.112635273" Jul 22 12:09:48.075074 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.075024 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bb9dd64d9-89v9h" podUID="cc415929-0118-449e-86b4-ea78283c5db6" containerName="console" containerID="cri-o://baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09" gracePeriod=15 Jul 22 12:09:48.317894 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.317870 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:09:48.430759 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.430759 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.430896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430770 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkhtr\" (UniqueName: \"kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.430896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430815 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.430896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430862 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.430896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430882 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.431095 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.430919 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca\") pod \"cc415929-0118-449e-86b4-ea78283c5db6\" (UID: \"cc415929-0118-449e-86b4-ea78283c5db6\") " Jul 22 12:09:48.431237 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.431212 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config" (OuterVolumeSpecName: "console-config") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:09:48.431344 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.431237 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:09:48.431423 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.431395 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:09:48.431517 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.431497 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:09:48.432708 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.432690 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:09:48.432837 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.432813 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:09:48.432939 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.432835 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr" (OuterVolumeSpecName: "kube-api-access-fkhtr") pod "cc415929-0118-449e-86b4-ea78283c5db6" (UID: "cc415929-0118-449e-86b4-ea78283c5db6"). InnerVolumeSpecName "kube-api-access-fkhtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:09:48.531779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531757 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkhtr\" (UniqueName: \"kubernetes.io/projected/cc415929-0118-449e-86b4-ea78283c5db6-kube-api-access-fkhtr\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531779 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531777 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-oauth-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531787 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-oauth-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531795 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531804 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-service-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531812 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc415929-0118-449e-86b4-ea78283c5db6-console-serving-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:48.531895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:48.531819 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc415929-0118-449e-86b4-ea78283c5db6-console-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:09:49.106642 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.106607 2564 generic.go:356] "Generic (PLEG): container finished" podID="cc415929-0118-449e-86b4-ea78283c5db6" containerID="baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09" exitCode=0 Jul 22 12:09:49.107087 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.106653 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb9dd64d9-89v9h" Jul 22 12:09:49.107087 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.106648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb9dd64d9-89v9h" event={"ID":"cc415929-0118-449e-86b4-ea78283c5db6","Type":"ContainerDied","Data":"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09"} Jul 22 12:09:49.107087 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.106767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb9dd64d9-89v9h" event={"ID":"cc415929-0118-449e-86b4-ea78283c5db6","Type":"ContainerDied","Data":"6224a6b77044e8d31b6609e61ac991c9923ae7b331c519e3d1ea3975b55274ef"} Jul 22 12:09:49.107087 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.106793 2564 scope.go:117] "RemoveContainer" containerID="baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09" Jul 22 12:09:49.115327 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.115307 2564 scope.go:117] "RemoveContainer" containerID="baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09" Jul 22 12:09:49.115574 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:09:49.115557 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09\": container with ID starting with baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09 not found: ID does not exist" containerID="baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09" Jul 22 12:09:49.115620 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.115582 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09"} err="failed to get container status \"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09\": rpc error: code = NotFound desc = could not find container \"baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09\": container with ID starting with baeeae45bec343528e175ba5f4169afc6aa73cfc94999ad5d3996c9c4bcfed09 not found: ID does not exist" Jul 22 12:09:49.124895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.124874 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:09:49.130508 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:49.130487 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb9dd64d9-89v9h"] Jul 22 12:09:50.595110 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:09:50.595079 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc415929-0118-449e-86b4-ea78283c5db6" path="/var/lib/kubelet/pods/cc415929-0118-449e-86b4-ea78283c5db6/volumes" Jul 22 12:10:03.723413 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.723381 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:03.723757 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.723727 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc415929-0118-449e-86b4-ea78283c5db6" containerName="console" Jul 22 12:10:03.723757 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.723738 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc415929-0118-449e-86b4-ea78283c5db6" containerName="console" Jul 22 12:10:03.723836 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.723825 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc415929-0118-449e-86b4-ea78283c5db6" containerName="console" Jul 22 12:10:03.834148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.834116 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:03.834296 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.834195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:03.836643 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.836621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ngc4b\"" Jul 22 12:10:03.951974 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.951947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5w2l\" (UniqueName: \"kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l\") pod \"authorino-58cd955675-nhhxs\" (UID: \"44dda06c-8e6d-4d5a-bafa-737b9f7e9921\") " pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:03.966167 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:03.966142 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:04.022846 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.022826 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:04.022946 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.022919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:04.052962 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.052939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5w2l\" (UniqueName: \"kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l\") pod \"authorino-58cd955675-nhhxs\" (UID: \"44dda06c-8e6d-4d5a-bafa-737b9f7e9921\") " pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:04.064880 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.064856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5w2l\" (UniqueName: \"kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l\") pod \"authorino-58cd955675-nhhxs\" (UID: \"44dda06c-8e6d-4d5a-bafa-737b9f7e9921\") " pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:04.143068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.143030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:04.153809 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.153785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hcqb\" (UniqueName: \"kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb\") pod \"authorino-75d556bd77-tbmlk\" (UID: \"863c6117-b63e-4bd6-bb70-5e90a4367d3d\") " pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:04.254753 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.254717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hcqb\" (UniqueName: \"kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb\") pod \"authorino-75d556bd77-tbmlk\" (UID: \"863c6117-b63e-4bd6-bb70-5e90a4367d3d\") " pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:04.268515 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.268490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hcqb\" (UniqueName: \"kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb\") pod \"authorino-75d556bd77-tbmlk\" (UID: \"863c6117-b63e-4bd6-bb70-5e90a4367d3d\") " pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:04.290865 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.290836 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:04.292407 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:10:04.292379 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44dda06c_8e6d_4d5a_bafa_737b9f7e9921.slice/crio-1bb0c4c78d5f869d759855758f57922d2b781d6fabed7668c1f4b6fd83109211 WatchSource:0}: Error finding container 1bb0c4c78d5f869d759855758f57922d2b781d6fabed7668c1f4b6fd83109211: Status 404 returned error can't find the container with id 1bb0c4c78d5f869d759855758f57922d2b781d6fabed7668c1f4b6fd83109211 Jul 22 12:10:04.331367 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.331329 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:04.506163 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:04.504955 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:04.510873 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:10:04.510848 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod863c6117_b63e_4bd6_bb70_5e90a4367d3d.slice/crio-85092c50873855cda715fd80a63c09cb87caed8a190f5af98d3ef60f43636f8f WatchSource:0}: Error finding container 85092c50873855cda715fd80a63c09cb87caed8a190f5af98d3ef60f43636f8f: Status 404 returned error can't find the container with id 85092c50873855cda715fd80a63c09cb87caed8a190f5af98d3ef60f43636f8f Jul 22 12:10:05.194108 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:05.194070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tbmlk" event={"ID":"863c6117-b63e-4bd6-bb70-5e90a4367d3d","Type":"ContainerStarted","Data":"85092c50873855cda715fd80a63c09cb87caed8a190f5af98d3ef60f43636f8f"} Jul 22 12:10:05.195146 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:05.195122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nhhxs" event={"ID":"44dda06c-8e6d-4d5a-bafa-737b9f7e9921","Type":"ContainerStarted","Data":"1bb0c4c78d5f869d759855758f57922d2b781d6fabed7668c1f4b6fd83109211"} Jul 22 12:10:10.236326 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:10.236289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tbmlk" event={"ID":"863c6117-b63e-4bd6-bb70-5e90a4367d3d","Type":"ContainerStarted","Data":"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb"} Jul 22 12:10:10.237740 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:10.237714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nhhxs" event={"ID":"44dda06c-8e6d-4d5a-bafa-737b9f7e9921","Type":"ContainerStarted","Data":"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06"} Jul 22 12:10:10.256191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:10.256149 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tbmlk" podStartSLOduration=2.003842643 podStartE2EDuration="7.256134682s" totalImagesPullingTime="5.252292039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:10:10.253956847 +0000 UTC m=+514.274346951" watchObservedRunningTime="2026-07-22 12:10:10.256134682 +0000 UTC m=+514.276524783" Jul 22 12:10:10.278427 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:10.278347 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-nhhxs" podStartSLOduration=1.818942155 podStartE2EDuration="7.278331007s" totalImagesPullingTime="5.459388852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:10:10.276257777 +0000 UTC m=+514.296647879" watchObservedRunningTime="2026-07-22 12:10:10.278331007 +0000 UTC m=+514.298721109" Jul 22 12:10:10.310598 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:10.310564 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:12.247608 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:12.247567 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-nhhxs" podUID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" containerName="authorino" containerID="cri-o://3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06" gracePeriod=30 Jul 22 12:10:12.488959 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:12.488934 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:12.633783 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:12.633755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5w2l\" (UniqueName: \"kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l\") pod \"44dda06c-8e6d-4d5a-bafa-737b9f7e9921\" (UID: \"44dda06c-8e6d-4d5a-bafa-737b9f7e9921\") " Jul 22 12:10:12.635634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:12.635614 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l" (OuterVolumeSpecName: "kube-api-access-r5w2l") pod "44dda06c-8e6d-4d5a-bafa-737b9f7e9921" (UID: "44dda06c-8e6d-4d5a-bafa-737b9f7e9921"). InnerVolumeSpecName "kube-api-access-r5w2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:10:12.734896 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:12.734874 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5w2l\" (UniqueName: \"kubernetes.io/projected/44dda06c-8e6d-4d5a-bafa-737b9f7e9921-kube-api-access-r5w2l\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:10:13.254074 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.254025 2564 generic.go:356] "Generic (PLEG): container finished" podID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" containerID="3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06" exitCode=0 Jul 22 12:10:13.254488 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.254085 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nhhxs" Jul 22 12:10:13.254488 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.254091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nhhxs" event={"ID":"44dda06c-8e6d-4d5a-bafa-737b9f7e9921","Type":"ContainerDied","Data":"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06"} Jul 22 12:10:13.254488 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.254140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nhhxs" event={"ID":"44dda06c-8e6d-4d5a-bafa-737b9f7e9921","Type":"ContainerDied","Data":"1bb0c4c78d5f869d759855758f57922d2b781d6fabed7668c1f4b6fd83109211"} Jul 22 12:10:13.254488 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.254169 2564 scope.go:117] "RemoveContainer" containerID="3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06" Jul 22 12:10:13.263076 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.263058 2564 scope.go:117] "RemoveContainer" containerID="3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06" Jul 22 12:10:13.263320 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:10:13.263295 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06\": container with ID starting with 3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06 not found: ID does not exist" containerID="3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06" Jul 22 12:10:13.263394 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.263333 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06"} err="failed to get container status \"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06\": rpc error: code = NotFound desc = could not find container \"3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06\": container with ID starting with 3f79c8fc11540529bc2c6267b176a149c4b49fd22883b66cbbe535935d818d06 not found: ID does not exist" Jul 22 12:10:13.276795 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.276773 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:13.285131 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:13.285106 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-nhhxs"] Jul 22 12:10:14.596369 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:14.596338 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" path="/var/lib/kubelet/pods/44dda06c-8e6d-4d5a-bafa-737b9f7e9921/volumes" Jul 22 12:10:37.286019 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.285944 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:37.286451 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.286312 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" containerName="authorino" Jul 22 12:10:37.286451 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.286324 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" containerName="authorino" Jul 22 12:10:37.286451 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.286399 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dda06c-8e6d-4d5a-bafa-737b9f7e9921" containerName="authorino" Jul 22 12:10:37.288454 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.288437 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:37.297327 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.297304 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:37.320296 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.320271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg48v\" (UniqueName: \"kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v\") pod \"authorino-5d4b67c446-tv6hz\" (UID: \"992efd91-47dd-47e4-9a4a-6b617e88f2ec\") " pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:37.421425 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.421401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg48v\" (UniqueName: \"kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v\") pod \"authorino-5d4b67c446-tv6hz\" (UID: \"992efd91-47dd-47e4-9a4a-6b617e88f2ec\") " pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:37.434352 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.434329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg48v\" (UniqueName: \"kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v\") pod \"authorino-5d4b67c446-tv6hz\" (UID: \"992efd91-47dd-47e4-9a4a-6b617e88f2ec\") " pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:37.533066 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.533016 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:37.533250 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.533234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:37.570653 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.570617 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bb9cf5c4b-jp5t4"] Jul 22 12:10:37.573686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.573667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:37.585449 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.585426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb9cf5c4b-jp5t4"] Jul 22 12:10:37.623685 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.623647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxd4g\" (UniqueName: \"kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g\") pod \"authorino-6bb9cf5c4b-jp5t4\" (UID: \"9b955382-8db3-4db3-82c3-feb69ff99a07\") " pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:37.658789 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.658763 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb9cf5c4b-jp5t4"] Jul 22 12:10:37.659084 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:10:37.659060 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wxd4g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" podUID="9b955382-8db3-4db3-82c3-feb69ff99a07" Jul 22 12:10:37.665435 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.665414 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:37.666920 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:10:37.666896 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod992efd91_47dd_47e4_9a4a_6b617e88f2ec.slice/crio-cc3f190235e2bb279b14244605366ad2296d6d2a8a88487e2cc796eb3a135b2f WatchSource:0}: Error finding container cc3f190235e2bb279b14244605366ad2296d6d2a8a88487e2cc796eb3a135b2f: Status 404 returned error can't find the container with id cc3f190235e2bb279b14244605366ad2296d6d2a8a88487e2cc796eb3a135b2f Jul 22 12:10:37.693651 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.693628 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:10:37.696204 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.696190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.698487 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.698472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 12:10:37.705279 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.705257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:10:37.724191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.724174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxd4g\" (UniqueName: \"kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g\") pod \"authorino-6bb9cf5c4b-jp5t4\" (UID: \"9b955382-8db3-4db3-82c3-feb69ff99a07\") " pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:37.724285 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.724221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.724285 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.724265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7rm\" (UniqueName: \"kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.733887 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.733870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxd4g\" (UniqueName: \"kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g\") pod \"authorino-6bb9cf5c4b-jp5t4\" (UID: \"9b955382-8db3-4db3-82c3-feb69ff99a07\") " pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:37.825365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.825310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.825444 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.825364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7rm\" (UniqueName: \"kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.827412 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.827394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:37.835283 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:37.835267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7rm\" (UniqueName: \"kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm\") pod \"authorino-75b7f5dc4-4qq75\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:38.005634 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.005614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:10:38.135293 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.135247 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:10:38.140483 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:10:38.140459 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcae789fe_1c0f_49a2_a181_4a0536830f08.slice/crio-bfb01ddde448a63707682595f613fe88f8fd51e44ab9b50df96e3cec73d386f0 WatchSource:0}: Error finding container bfb01ddde448a63707682595f613fe88f8fd51e44ab9b50df96e3cec73d386f0: Status 404 returned error can't find the container with id bfb01ddde448a63707682595f613fe88f8fd51e44ab9b50df96e3cec73d386f0 Jul 22 12:10:38.394533 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.394462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" event={"ID":"cae789fe-1c0f-49a2-a181-4a0536830f08","Type":"ContainerStarted","Data":"bfb01ddde448a63707682595f613fe88f8fd51e44ab9b50df96e3cec73d386f0"} Jul 22 12:10:38.395588 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.395561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" event={"ID":"992efd91-47dd-47e4-9a4a-6b617e88f2ec","Type":"ContainerStarted","Data":"cc3f190235e2bb279b14244605366ad2296d6d2a8a88487e2cc796eb3a135b2f"} Jul 22 12:10:38.395698 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.395621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:38.402291 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.402274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:38.431002 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.430977 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxd4g\" (UniqueName: \"kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g\") pod \"9b955382-8db3-4db3-82c3-feb69ff99a07\" (UID: \"9b955382-8db3-4db3-82c3-feb69ff99a07\") " Jul 22 12:10:38.432716 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.432692 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g" (OuterVolumeSpecName: "kube-api-access-wxd4g") pod "9b955382-8db3-4db3-82c3-feb69ff99a07" (UID: "9b955382-8db3-4db3-82c3-feb69ff99a07"). InnerVolumeSpecName "kube-api-access-wxd4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:10:38.532597 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:38.532571 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxd4g\" (UniqueName: \"kubernetes.io/projected/9b955382-8db3-4db3-82c3-feb69ff99a07-kube-api-access-wxd4g\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:10:39.403564 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.403526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" event={"ID":"992efd91-47dd-47e4-9a4a-6b617e88f2ec","Type":"ContainerStarted","Data":"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb"} Jul 22 12:10:39.403564 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.403545 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" podUID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" containerName="authorino" containerID="cri-o://fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb" gracePeriod=30 Jul 22 12:10:39.405324 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.405293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb9cf5c4b-jp5t4" Jul 22 12:10:39.405476 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.405365 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" event={"ID":"cae789fe-1c0f-49a2-a181-4a0536830f08","Type":"ContainerStarted","Data":"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a"} Jul 22 12:10:39.426310 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.426266 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" podStartSLOduration=1.6793078750000001 podStartE2EDuration="2.426252818s" totalImagesPullingTime="746.944943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:10:39.425547714 +0000 UTC m=+543.445937815" watchObservedRunningTime="2026-07-22 12:10:39.426252818 +0000 UTC m=+543.446642920" Jul 22 12:10:39.453372 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.453332 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" podStartSLOduration=1.970471219 podStartE2EDuration="2.453319693s" totalImagesPullingTime="482.848474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:10:39.451137688 +0000 UTC m=+543.471527789" watchObservedRunningTime="2026-07-22 12:10:39.453319693 +0000 UTC m=+543.473709863" Jul 22 12:10:39.489104 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.489079 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb9cf5c4b-jp5t4"] Jul 22 12:10:39.497079 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.497059 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:39.497254 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.497228 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tbmlk" podUID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" containerName="authorino" containerID="cri-o://c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb" gracePeriod=30 Jul 22 12:10:39.501249 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.501228 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bb9cf5c4b-jp5t4"] Jul 22 12:10:39.754897 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.754877 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:39.757898 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.757881 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:39.844423 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.844399 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hcqb\" (UniqueName: \"kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb\") pod \"863c6117-b63e-4bd6-bb70-5e90a4367d3d\" (UID: \"863c6117-b63e-4bd6-bb70-5e90a4367d3d\") " Jul 22 12:10:39.844544 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.844465 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg48v\" (UniqueName: \"kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v\") pod \"992efd91-47dd-47e4-9a4a-6b617e88f2ec\" (UID: \"992efd91-47dd-47e4-9a4a-6b617e88f2ec\") " Jul 22 12:10:39.846377 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.846352 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb" (OuterVolumeSpecName: "kube-api-access-9hcqb") pod "863c6117-b63e-4bd6-bb70-5e90a4367d3d" (UID: "863c6117-b63e-4bd6-bb70-5e90a4367d3d"). InnerVolumeSpecName "kube-api-access-9hcqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:10:39.846454 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.846375 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v" (OuterVolumeSpecName: "kube-api-access-rg48v") pod "992efd91-47dd-47e4-9a4a-6b617e88f2ec" (UID: "992efd91-47dd-47e4-9a4a-6b617e88f2ec"). InnerVolumeSpecName "kube-api-access-rg48v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:10:39.945257 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.945198 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hcqb\" (UniqueName: \"kubernetes.io/projected/863c6117-b63e-4bd6-bb70-5e90a4367d3d-kube-api-access-9hcqb\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:10:39.945257 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:39.945222 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg48v\" (UniqueName: \"kubernetes.io/projected/992efd91-47dd-47e4-9a4a-6b617e88f2ec-kube-api-access-rg48v\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:10:40.412224 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.412193 2564 generic.go:356] "Generic (PLEG): container finished" podID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" containerID="fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb" exitCode=0 Jul 22 12:10:40.412607 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.412228 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" Jul 22 12:10:40.412607 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.412280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" event={"ID":"992efd91-47dd-47e4-9a4a-6b617e88f2ec","Type":"ContainerDied","Data":"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb"} Jul 22 12:10:40.412607 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.412317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tv6hz" event={"ID":"992efd91-47dd-47e4-9a4a-6b617e88f2ec","Type":"ContainerDied","Data":"cc3f190235e2bb279b14244605366ad2296d6d2a8a88487e2cc796eb3a135b2f"} Jul 22 12:10:40.412607 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.412343 2564 scope.go:117] "RemoveContainer" containerID="fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb" Jul 22 12:10:40.413757 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.413734 2564 generic.go:356] "Generic (PLEG): container finished" podID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" containerID="c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb" exitCode=0 Jul 22 12:10:40.413857 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.413767 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tbmlk" Jul 22 12:10:40.413857 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.413816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tbmlk" event={"ID":"863c6117-b63e-4bd6-bb70-5e90a4367d3d","Type":"ContainerDied","Data":"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb"} Jul 22 12:10:40.413979 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.413861 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tbmlk" event={"ID":"863c6117-b63e-4bd6-bb70-5e90a4367d3d","Type":"ContainerDied","Data":"85092c50873855cda715fd80a63c09cb87caed8a190f5af98d3ef60f43636f8f"} Jul 22 12:10:40.422693 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.422677 2564 scope.go:117] "RemoveContainer" containerID="fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb" Jul 22 12:10:40.422965 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:10:40.422948 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb\": container with ID starting with fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb not found: ID does not exist" containerID="fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb" Jul 22 12:10:40.423023 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.422975 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb"} err="failed to get container status \"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb\": rpc error: code = NotFound desc = could not find container \"fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb\": container with ID starting with fd08f96064de48c64dce0b15c5c96f669310d50a1b02f48f89eee61ab609dbbb not found: ID does not exist" Jul 22 12:10:40.423023 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.422996 2564 scope.go:117] "RemoveContainer" containerID="c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb" Jul 22 12:10:40.430968 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.430952 2564 scope.go:117] "RemoveContainer" containerID="c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb" Jul 22 12:10:40.431219 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:10:40.431195 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb\": container with ID starting with c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb not found: ID does not exist" containerID="c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb" Jul 22 12:10:40.431317 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.431221 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb"} err="failed to get container status \"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb\": rpc error: code = NotFound desc = could not find container \"c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb\": container with ID starting with c1893ad30bcbf479b4cf28d35c2d5bda4f08d626dbeb7c97d7b01a761ba106bb not found: ID does not exist" Jul 22 12:10:40.458161 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.458142 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:40.467883 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.467861 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tv6hz"] Jul 22 12:10:40.500434 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.500408 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:40.505915 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.505891 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tbmlk"] Jul 22 12:10:40.594940 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.594917 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" path="/var/lib/kubelet/pods/863c6117-b63e-4bd6-bb70-5e90a4367d3d/volumes" Jul 22 12:10:40.595243 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.595230 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" path="/var/lib/kubelet/pods/992efd91-47dd-47e4-9a4a-6b617e88f2ec/volumes" Jul 22 12:10:40.595511 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:10:40.595500 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b955382-8db3-4db3-82c3-feb69ff99a07" path="/var/lib/kubelet/pods/9b955382-8db3-4db3-82c3-feb69ff99a07/volumes" Jul 22 12:11:20.540608 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.540574 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8f5mm"] Jul 22 12:11:20.541164 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541124 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" containerName="authorino" Jul 22 12:11:20.541164 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541149 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" containerName="authorino" Jul 22 12:11:20.541298 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541188 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" containerName="authorino" Jul 22 12:11:20.541298 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541197 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" containerName="authorino" Jul 22 12:11:20.541395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541297 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="992efd91-47dd-47e4-9a4a-6b617e88f2ec" containerName="authorino" Jul 22 12:11:20.541395 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.541339 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="863c6117-b63e-4bd6-bb70-5e90a4367d3d" containerName="authorino" Jul 22 12:11:20.544387 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.544365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.546799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.546780 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fmqqd\"" Jul 22 12:11:20.547099 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.547084 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 12:11:20.555263 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.555243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8f5mm"] Jul 22 12:11:20.610077 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.610036 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-msgqr"] Jul 22 12:11:20.613248 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.613230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.626647 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.626626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-msgqr"] Jul 22 12:11:20.668537 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.668509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae44066e-81b6-426c-a1ba-6a7566e65d06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.668637 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.668565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqr2\" (UniqueName: \"kubernetes.io/projected/ae44066e-81b6-426c-a1ba-6a7566e65d06-kube-api-access-tgqr2\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.769635 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.769610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b704ab56-635c-4a60-831a-aa55a14bf40f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.769725 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.769650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjctd\" (UniqueName: \"kubernetes.io/projected/b704ab56-635c-4a60-831a-aa55a14bf40f-kube-api-access-wjctd\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.769725 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.769679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae44066e-81b6-426c-a1ba-6a7566e65d06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.769799 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.769751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqr2\" (UniqueName: \"kubernetes.io/projected/ae44066e-81b6-426c-a1ba-6a7566e65d06-kube-api-access-tgqr2\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.770331 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.770314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae44066e-81b6-426c-a1ba-6a7566e65d06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.783167 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.783136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqr2\" (UniqueName: \"kubernetes.io/projected/ae44066e-81b6-426c-a1ba-6a7566e65d06-kube-api-access-tgqr2\") pod \"payload-pre-processing-7677b774bb-8f5mm\" (UID: \"ae44066e-81b6-426c-a1ba-6a7566e65d06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.854633 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.854578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:20.870894 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.870855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b704ab56-635c-4a60-831a-aa55a14bf40f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.871008 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.870934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjctd\" (UniqueName: \"kubernetes.io/projected/b704ab56-635c-4a60-831a-aa55a14bf40f-kube-api-access-wjctd\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.871723 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.871701 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b704ab56-635c-4a60-831a-aa55a14bf40f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.885211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.885184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjctd\" (UniqueName: \"kubernetes.io/projected/b704ab56-635c-4a60-831a-aa55a14bf40f-kube-api-access-wjctd\") pod \"payload-processing-5bf47cd988-msgqr\" (UID: \"b704ab56-635c-4a60-831a-aa55a14bf40f\") " pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:20.922591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:20.922559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:21.002912 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:11:21.002880 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae44066e_81b6_426c_a1ba_6a7566e65d06.slice/crio-34e4b4ada622a6055764c4748aedae429d201695f32c09ceafaec17437369a26 WatchSource:0}: Error finding container 34e4b4ada622a6055764c4748aedae429d201695f32c09ceafaec17437369a26: Status 404 returned error can't find the container with id 34e4b4ada622a6055764c4748aedae429d201695f32c09ceafaec17437369a26 Jul 22 12:11:21.003323 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:21.003298 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8f5mm"] Jul 22 12:11:21.066695 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:21.066669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-msgqr"] Jul 22 12:11:21.067854 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:11:21.067828 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb704ab56_635c_4a60_831a_aa55a14bf40f.slice/crio-9a4e464b8f72dc64ff6b5259b1a59a9b2e91b31cee3845ac0df717a2c3a083c9 WatchSource:0}: Error finding container 9a4e464b8f72dc64ff6b5259b1a59a9b2e91b31cee3845ac0df717a2c3a083c9: Status 404 returned error can't find the container with id 9a4e464b8f72dc64ff6b5259b1a59a9b2e91b31cee3845ac0df717a2c3a083c9 Jul 22 12:11:21.653698 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:21.653615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" event={"ID":"b704ab56-635c-4a60-831a-aa55a14bf40f","Type":"ContainerStarted","Data":"9a4e464b8f72dc64ff6b5259b1a59a9b2e91b31cee3845ac0df717a2c3a083c9"} Jul 22 12:11:21.655418 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:21.655387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" event={"ID":"ae44066e-81b6-426c-a1ba-6a7566e65d06","Type":"ContainerStarted","Data":"34e4b4ada622a6055764c4748aedae429d201695f32c09ceafaec17437369a26"} Jul 22 12:11:23.669717 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.669681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" event={"ID":"b704ab56-635c-4a60-831a-aa55a14bf40f","Type":"ContainerStarted","Data":"218f07ebfd97373729419e215f01cd1cc5ac5f4dc6c20d0044d258544109eb08"} Jul 22 12:11:23.670191 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.669846 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:23.671456 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.671428 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" event={"ID":"ae44066e-81b6-426c-a1ba-6a7566e65d06","Type":"ContainerStarted","Data":"7a69fba08c78b4a7bf75e61a08db06df5854b4210851ea3c6d906735607daaec"} Jul 22 12:11:23.671581 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.671517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:23.692834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.692778 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" podStartSLOduration=1.977915518 podStartE2EDuration="3.692763377s" totalImagesPullingTime="1.714847859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:11:23.691579939 +0000 UTC m=+587.711970039" watchObservedRunningTime="2026-07-22 12:11:23.692763377 +0000 UTC m=+587.713153480" Jul 22 12:11:23.715529 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:23.715490 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" podStartSLOduration=1.942088779 podStartE2EDuration="3.715478573s" totalImagesPullingTime="1.773389794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:11:23.712889369 +0000 UTC m=+587.733279470" watchObservedRunningTime="2026-07-22 12:11:23.715478573 +0000 UTC m=+587.735868674" Jul 22 12:11:34.679267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:34.679229 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8f5mm" Jul 22 12:11:34.679685 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:34.679310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-msgqr" Jul 22 12:11:36.465798 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:36.465771 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:11:36.467016 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:11:36.466994 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:12:14.100680 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.100600 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn"] Jul 22 12:12:14.104148 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.104130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.106816 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.106793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 12:12:14.106940 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.106883 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 12:12:14.107672 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.107653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gf6j9\"" Jul 22 12:12:14.107786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.107681 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 22 12:12:14.119436 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.119413 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn"] Jul 22 12:12:14.196715 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v4sb\" (UniqueName: \"kubernetes.io/projected/696f0b01-a565-41b3-a817-d6f63fd8cdba-kube-api-access-6v4sb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.196812 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.196812 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/696f0b01-a565-41b3-a817-d6f63fd8cdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.196904 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.196904 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.196904 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.196889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.297985 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.297958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v4sb\" (UniqueName: \"kubernetes.io/projected/696f0b01-a565-41b3-a817-d6f63fd8cdba-kube-api-access-6v4sb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.297997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/696f0b01-a565-41b3-a817-d6f63fd8cdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298124 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298370 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298428 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298503 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.298554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.298505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.300446 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.300418 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/696f0b01-a565-41b3-a817-d6f63fd8cdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.300645 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.300624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/696f0b01-a565-41b3-a817-d6f63fd8cdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.308527 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.308505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v4sb\" (UniqueName: \"kubernetes.io/projected/696f0b01-a565-41b3-a817-d6f63fd8cdba-kube-api-access-6v4sb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htrmn\" (UID: \"696f0b01-a565-41b3-a817-d6f63fd8cdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.414393 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.414342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:14.554616 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.554592 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn"] Jul 22 12:12:14.560316 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.560291 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:12:14.966272 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:14.966231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" event={"ID":"696f0b01-a565-41b3-a817-d6f63fd8cdba","Type":"ContainerStarted","Data":"d12a850e6392454a7992ed9917afffe46c642040e454d7cc8922d3961031f97d"} Jul 22 12:12:15.974160 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:15.974077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" event={"ID":"696f0b01-a565-41b3-a817-d6f63fd8cdba","Type":"ContainerStarted","Data":"6d756c881a78236698081d4632e66b6afa1039e3970b5ca2679d69d6cee0db6d"} Jul 22 12:12:16.002591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:16.002541 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" podStartSLOduration=0.898708623 podStartE2EDuration="2.00252664s" totalImagesPullingTime="1.103818017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:12:15.999446885 +0000 UTC m=+640.019836994" watchObservedRunningTime="2026-07-22 12:12:16.00252664 +0000 UTC m=+640.022916741" Jul 22 12:12:24.415367 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:24.415330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:24.415871 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:24.415422 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:24.427709 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:24.427684 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:25.035918 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:25.035890 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htrmn" Jul 22 12:12:39.814357 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.814325 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2"] Jul 22 12:12:39.817035 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.817018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.819306 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.819284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 12:12:39.832198 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.832173 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2"] Jul 22 12:12:39.899204 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.899301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.899301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.899385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.899385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzhjl\" (UniqueName: \"kubernetes.io/projected/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-kube-api-access-vzhjl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:39.899487 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:39.899427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000601 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000689 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000744 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000744 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzhjl\" (UniqueName: \"kubernetes.io/projected/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-kube-api-access-vzhjl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.000968 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.000947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.001035 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.001015 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.001131 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.001099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.003028 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.002999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.003133 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.003109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.009821 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.009800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzhjl\" (UniqueName: \"kubernetes.io/projected/d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7-kube-api-access-vzhjl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2\" (UID: \"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.127407 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.127348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:40.280696 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:40.280672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2"] Jul 22 12:12:40.282076 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:12:40.282012 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b996e1_9586_41b8_bdae_1a6fc7ad4ec7.slice/crio-87fa0dfa7045ecd02d117e3a0e666c80f45618ba13a47280f53a03d56d6cfdb6 WatchSource:0}: Error finding container 87fa0dfa7045ecd02d117e3a0e666c80f45618ba13a47280f53a03d56d6cfdb6: Status 404 returned error can't find the container with id 87fa0dfa7045ecd02d117e3a0e666c80f45618ba13a47280f53a03d56d6cfdb6 Jul 22 12:12:41.133665 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:41.133621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" event={"ID":"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7","Type":"ContainerStarted","Data":"19a787861bd8919bae573d3c0bb689b433c045fb1edff413b710c2d50c11a888"} Jul 22 12:12:41.134074 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:41.133721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" event={"ID":"d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7","Type":"ContainerStarted","Data":"87fa0dfa7045ecd02d117e3a0e666c80f45618ba13a47280f53a03d56d6cfdb6"} Jul 22 12:12:41.160262 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:41.160206 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" podStartSLOduration=1.9649952910000001 podStartE2EDuration="2.16019135s" totalImagesPullingTime="195.196059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:12:41.156764513 +0000 UTC m=+665.177154617" watchObservedRunningTime="2026-07-22 12:12:41.16019135 +0000 UTC m=+665.180581451" Jul 22 12:12:50.115591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.115554 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng"] Jul 22 12:12:50.118829 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.118811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.123324 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.123304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 22 12:12:50.128007 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.127988 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:50.128343 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.128316 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:50.140049 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.140028 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:50.152186 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.152166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng"] Jul 22 12:12:50.182261 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.182355 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.182355 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.182462 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5lb9\" (UniqueName: \"kubernetes.io/projected/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-kube-api-access-l5lb9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.182462 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.182591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.182575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.196710 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.196689 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2" Jul 22 12:12:50.283547 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283657 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5lb9\" (UniqueName: \"kubernetes.io/projected/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-kube-api-access-l5lb9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283891 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283931 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.283965 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.283934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.284128 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.284109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.285710 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.285693 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.286000 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.285979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.301520 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.301502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5lb9\" (UniqueName: \"kubernetes.io/projected/f6160b4f-24d0-464b-b8b5-a1e8b833b8f1-kube-api-access-l5lb9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4nng\" (UID: \"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.429314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.429249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:12:50.561303 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:50.561276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng"] Jul 22 12:12:50.563145 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:12:50.563121 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6160b4f_24d0_464b_b8b5_a1e8b833b8f1.slice/crio-3fcb1a812cba69f7da3456c8cb58c2948f0e80a2054a3e54ed8651afbc271682 WatchSource:0}: Error finding container 3fcb1a812cba69f7da3456c8cb58c2948f0e80a2054a3e54ed8651afbc271682: Status 404 returned error can't find the container with id 3fcb1a812cba69f7da3456c8cb58c2948f0e80a2054a3e54ed8651afbc271682 Jul 22 12:12:51.193611 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:51.193570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" event={"ID":"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1","Type":"ContainerStarted","Data":"2d58461c7e914bf2a8244fdd927d07a0aa7da9d9e2eee44af24c7ef2357d219a"} Jul 22 12:12:51.193988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:51.193620 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" event={"ID":"f6160b4f-24d0-464b-b8b5-a1e8b833b8f1","Type":"ContainerStarted","Data":"3fcb1a812cba69f7da3456c8cb58c2948f0e80a2054a3e54ed8651afbc271682"} Jul 22 12:12:51.215941 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:12:51.215889 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" podStartSLOduration=1.042603529 podStartE2EDuration="1.215870814s" totalImagesPullingTime="173.267285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:12:51.214034988 +0000 UTC m=+675.234425108" watchObservedRunningTime="2026-07-22 12:12:51.215870814 +0000 UTC m=+675.236260917" Jul 22 12:13:00.430259 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:00.430222 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:13:00.430718 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:00.430272 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:13:00.442081 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:00.442056 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:13:01.260558 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:01.260526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4nng" Jul 22 12:13:49.738302 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.738225 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d8484dbc5-qjg5h"] Jul 22 12:13:49.741747 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.741729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.751217 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.751194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8484dbc5-qjg5h"] Jul 22 12:13:49.758801 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.758779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-tls-cert\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.758915 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.758817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbp5x\" (UniqueName: \"kubernetes.io/projected/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-kube-api-access-fbp5x\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.859531 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.859507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-tls-cert\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.859625 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.859536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbp5x\" (UniqueName: \"kubernetes.io/projected/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-kube-api-access-fbp5x\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.861843 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.861798 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-tls-cert\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:49.869322 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:49.869303 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbp5x\" (UniqueName: \"kubernetes.io/projected/1bb9cf62-9831-42a0-bb2d-2afa6bf63147-kube-api-access-fbp5x\") pod \"authorino-d8484dbc5-qjg5h\" (UID: \"1bb9cf62-9831-42a0-bb2d-2afa6bf63147\") " pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:50.051385 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:50.051360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8484dbc5-qjg5h" Jul 22 12:13:50.213835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:50.213811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8484dbc5-qjg5h"] Jul 22 12:13:50.214759 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:13:50.214727 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bb9cf62_9831_42a0_bb2d_2afa6bf63147.slice/crio-3391edbfcc79cc5cb682b465060591c3a61dd1ffdd14745a92422079f2ee3686 WatchSource:0}: Error finding container 3391edbfcc79cc5cb682b465060591c3a61dd1ffdd14745a92422079f2ee3686: Status 404 returned error can't find the container with id 3391edbfcc79cc5cb682b465060591c3a61dd1ffdd14745a92422079f2ee3686 Jul 22 12:13:50.518577 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:50.518508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8484dbc5-qjg5h" event={"ID":"1bb9cf62-9831-42a0-bb2d-2afa6bf63147","Type":"ContainerStarted","Data":"3391edbfcc79cc5cb682b465060591c3a61dd1ffdd14745a92422079f2ee3686"} Jul 22 12:13:51.526735 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.526694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8484dbc5-qjg5h" event={"ID":"1bb9cf62-9831-42a0-bb2d-2afa6bf63147","Type":"ContainerStarted","Data":"1a43c389d57a6aefedff227b41604806bd9a49adce06a7f8868253b827816e9b"} Jul 22 12:13:51.559609 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.559537 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d8484dbc5-qjg5h" podStartSLOduration=2.146087235 podStartE2EDuration="2.559515444s" totalImagesPullingTime="413.428209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:13:51.555840312 +0000 UTC m=+735.576230413" watchObservedRunningTime="2026-07-22 12:13:51.559515444 +0000 UTC m=+735.579905546" Jul 22 12:13:51.600661 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.598729 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:13:51.600661 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.598954 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" podUID="cae789fe-1c0f-49a2-a181-4a0536830f08" containerName="authorino" containerID="cri-o://4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a" gracePeriod=30 Jul 22 12:13:51.871190 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.871162 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:13:51.978083 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.978027 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw7rm\" (UniqueName: \"kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm\") pod \"cae789fe-1c0f-49a2-a181-4a0536830f08\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " Jul 22 12:13:51.978246 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.978165 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert\") pod \"cae789fe-1c0f-49a2-a181-4a0536830f08\" (UID: \"cae789fe-1c0f-49a2-a181-4a0536830f08\") " Jul 22 12:13:51.980145 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.980120 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm" (OuterVolumeSpecName: "kube-api-access-dw7rm") pod "cae789fe-1c0f-49a2-a181-4a0536830f08" (UID: "cae789fe-1c0f-49a2-a181-4a0536830f08"). InnerVolumeSpecName "kube-api-access-dw7rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:13:51.990253 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:51.990230 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cae789fe-1c0f-49a2-a181-4a0536830f08" (UID: "cae789fe-1c0f-49a2-a181-4a0536830f08"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:13:52.079734 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.079704 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cae789fe-1c0f-49a2-a181-4a0536830f08-tls-cert\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:13:52.079734 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.079731 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw7rm\" (UniqueName: \"kubernetes.io/projected/cae789fe-1c0f-49a2-a181-4a0536830f08-kube-api-access-dw7rm\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:13:52.533353 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.533317 2564 generic.go:356] "Generic (PLEG): container finished" podID="cae789fe-1c0f-49a2-a181-4a0536830f08" containerID="4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a" exitCode=0 Jul 22 12:13:52.533813 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.533362 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" Jul 22 12:13:52.533813 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.533404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" event={"ID":"cae789fe-1c0f-49a2-a181-4a0536830f08","Type":"ContainerDied","Data":"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a"} Jul 22 12:13:52.533813 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.533441 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b7f5dc4-4qq75" event={"ID":"cae789fe-1c0f-49a2-a181-4a0536830f08","Type":"ContainerDied","Data":"bfb01ddde448a63707682595f613fe88f8fd51e44ab9b50df96e3cec73d386f0"} Jul 22 12:13:52.533813 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.533458 2564 scope.go:117] "RemoveContainer" containerID="4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a" Jul 22 12:13:52.543165 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.543150 2564 scope.go:117] "RemoveContainer" containerID="4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a" Jul 22 12:13:52.543436 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:13:52.543413 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a\": container with ID starting with 4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a not found: ID does not exist" containerID="4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a" Jul 22 12:13:52.543516 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.543443 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a"} err="failed to get container status \"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a\": rpc error: code = NotFound desc = could not find container \"4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a\": container with ID starting with 4f31d6e0be656b071ccc420674a297666a70bb6881aed77d6d51ce43f63b676a not found: ID does not exist" Jul 22 12:13:52.572630 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.572603 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:13:52.575170 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.575150 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75b7f5dc4-4qq75"] Jul 22 12:13:52.595207 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:13:52.595183 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cae789fe-1c0f-49a2-a181-4a0536830f08" path="/var/lib/kubelet/pods/cae789fe-1c0f-49a2-a181-4a0536830f08/volumes" Jul 22 12:16:36.514893 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:16:36.514806 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:16:36.515932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:16:36.515907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:21:36.554356 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:21:36.554327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:21:36.556390 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:21:36.556366 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:24:30.407267 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.407182 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:24:30.407834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.407652 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae789fe-1c0f-49a2-a181-4a0536830f08" containerName="authorino" Jul 22 12:24:30.407834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.407665 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae789fe-1c0f-49a2-a181-4a0536830f08" containerName="authorino" Jul 22 12:24:30.407834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.407729 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae789fe-1c0f-49a2-a181-4a0536830f08" containerName="authorino" Jul 22 12:24:30.410808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.410780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.413506 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.413476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-be372d4c-kserve-self-signed-certs\"" Jul 22 12:24:30.426764 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.426743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:24:30.586661 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.586835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.586835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.586932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.586932 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmv7z\" (UniqueName: \"kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.587007 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.586931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688378 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688378 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688378 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmv7z\" (UniqueName: \"kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688593 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688780 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688854 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.688913 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.688889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.690603 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.690584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.690851 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.690833 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.696601 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.696580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmv7z\" (UniqueName: \"kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z\") pod \"e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.720127 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.720102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:30.850681 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:30.850650 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:24:30.851987 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:24:30.851966 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38e8e341_7b5c_484f_b649_28676d6d82db.slice/crio-6e5f18bea78e0da80277d7825a44f43ae37dedfbb63711303a7f25f02bfb8e75 WatchSource:0}: Error finding container 6e5f18bea78e0da80277d7825a44f43ae37dedfbb63711303a7f25f02bfb8e75: Status 404 returned error can't find the container with id 6e5f18bea78e0da80277d7825a44f43ae37dedfbb63711303a7f25f02bfb8e75 Jul 22 12:24:31.142166 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:31.142128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" event={"ID":"38e8e341-7b5c-484f-b649-28676d6d82db","Type":"ContainerStarted","Data":"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44"} Jul 22 12:24:31.142305 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:31.142176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" event={"ID":"38e8e341-7b5c-484f-b649-28676d6d82db","Type":"ContainerStarted","Data":"6e5f18bea78e0da80277d7825a44f43ae37dedfbb63711303a7f25f02bfb8e75"} Jul 22 12:24:31.160100 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:31.160060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" podStartSLOduration=1.1600295250000001 podStartE2EDuration="1.160029525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:24:31.158619217 +0000 UTC m=+1375.179009330" watchObservedRunningTime="2026-07-22 12:24:31.160029525 +0000 UTC m=+1375.180419626" Jul 22 12:24:40.720365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:40.720281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:40.720770 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:40.720508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:40.732661 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:40.732638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:24:41.215278 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:24:41.215247 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:25:06.433916 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:06.433882 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:25:21.454358 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.454302 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" podUID="38e8e341-7b5c-484f-b649-28676d6d82db" containerName="main" containerID="cri-o://e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44" gracePeriod=45 Jul 22 12:25:21.706653 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.706597 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:25:21.756258 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756230 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756406 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756406 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756296 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmv7z\" (UniqueName: \"kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756406 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756326 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756406 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756630 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756420 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs\") pod \"38e8e341-7b5c-484f-b649-28676d6d82db\" (UID: \"38e8e341-7b5c-484f-b649-28676d6d82db\") " Jul 22 12:25:21.756630 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756542 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache" (OuterVolumeSpecName: "model-cache") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:25:21.756630 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756588 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home" (OuterVolumeSpecName: "home") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:25:21.756772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756692 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:25:21.756772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756763 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-model-cache\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:21.756873 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.756781 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-home\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:21.758476 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.758444 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm" (OuterVolumeSpecName: "dshm") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:25:21.758596 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.758536 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z" (OuterVolumeSpecName: "kube-api-access-tmv7z") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "kube-api-access-tmv7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:25:21.758596 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.758542 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38e8e341-7b5c-484f-b649-28676d6d82db" (UID: "38e8e341-7b5c-484f-b649-28676d6d82db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:25:21.857900 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.857881 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-dshm\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:21.858004 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.857901 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmv7z\" (UniqueName: \"kubernetes.io/projected/38e8e341-7b5c-484f-b649-28676d6d82db-kube-api-access-tmv7z\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:21.858004 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.857913 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e8e341-7b5c-484f-b649-28676d6d82db-tmp-dir\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:21.858004 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:21.857921 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e8e341-7b5c-484f-b649-28676d6d82db-tls-certs\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:25:22.440524 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.440489 2564 generic.go:356] "Generic (PLEG): container finished" podID="38e8e341-7b5c-484f-b649-28676d6d82db" containerID="e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44" exitCode=0 Jul 22 12:25:22.440677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.440534 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" Jul 22 12:25:22.440677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.440551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" event={"ID":"38e8e341-7b5c-484f-b649-28676d6d82db","Type":"ContainerDied","Data":"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44"} Jul 22 12:25:22.440677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.440588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s" event={"ID":"38e8e341-7b5c-484f-b649-28676d6d82db","Type":"ContainerDied","Data":"6e5f18bea78e0da80277d7825a44f43ae37dedfbb63711303a7f25f02bfb8e75"} Jul 22 12:25:22.440677 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.440609 2564 scope.go:117] "RemoveContainer" containerID="e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44" Jul 22 12:25:22.449898 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.449876 2564 scope.go:117] "RemoveContainer" containerID="e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44" Jul 22 12:25:22.450160 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:25:22.450142 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44\": container with ID starting with e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44 not found: ID does not exist" containerID="e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44" Jul 22 12:25:22.450231 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.450168 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44"} err="failed to get container status \"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44\": rpc error: code = NotFound desc = could not find container \"e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44\": container with ID starting with e8d9972bfdd0aeb1b5ab0705af2cd5defcacc6c8450f64af0751c8b4a9b6ff44 not found: ID does not exist" Jul 22 12:25:22.463350 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.463329 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:25:22.467736 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.467716 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-be372d4c-kserve-56b4c7844c-7zz5s"] Jul 22 12:25:22.595076 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:25:22.595034 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e8e341-7b5c-484f-b649-28676d6d82db" path="/var/lib/kubelet/pods/38e8e341-7b5c-484f-b649-28676d6d82db/volumes" Jul 22 12:26:36.599614 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:26:36.599584 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:26:36.602670 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:26:36.602649 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:31:36.637859 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:31:36.637833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:31:36.642109 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:31:36.642087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:36:36.675878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:36:36.675813 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:36:36.682580 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:36:36.682558 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:39:15.468014 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.467929 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt"] Jul 22 12:39:15.468505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.468369 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e8e341-7b5c-484f-b649-28676d6d82db" containerName="main" Jul 22 12:39:15.468505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.468383 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e8e341-7b5c-484f-b649-28676d6d82db" containerName="main" Jul 22 12:39:15.468505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.468467 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e8e341-7b5c-484f-b649-28676d6d82db" containerName="main" Jul 22 12:39:15.471604 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.471586 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:15.473910 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.473889 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 12:39:15.474033 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.474002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87ltg\"" Jul 22 12:39:15.478709 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.478684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt"] Jul 22 12:39:15.483369 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.483337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt\" (UID: \"7622de4e-6a47-47bf-994a-6690fa645d20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:15.583888 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.583853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt\" (UID: \"7622de4e-6a47-47bf-994a-6690fa645d20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:15.584554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.584527 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt\" (UID: \"7622de4e-6a47-47bf-994a-6690fa645d20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:15.784184 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:15.784155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:16.125210 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:16.125185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt"] Jul 22 12:39:16.126775 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:39:16.126747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7622de4e_6a47_47bf_994a_6690fa645d20.slice/crio-50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc WatchSource:0}: Error finding container 50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc: Status 404 returned error can't find the container with id 50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc Jul 22 12:39:16.128531 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:16.128514 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:39:17.124735 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:17.124633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" event={"ID":"7622de4e-6a47-47bf-994a-6690fa645d20","Type":"ContainerStarted","Data":"50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc"} Jul 22 12:39:19.139512 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:19.139476 2564 generic.go:356] "Generic (PLEG): container finished" podID="7622de4e-6a47-47bf-994a-6690fa645d20" containerID="102d86c12694906437c0821344eec04ea82c2d78b766033337f9cf3f964eaf0f" exitCode=0 Jul 22 12:39:19.139906 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:19.139558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" event={"ID":"7622de4e-6a47-47bf-994a-6690fa645d20","Type":"ContainerDied","Data":"102d86c12694906437c0821344eec04ea82c2d78b766033337f9cf3f964eaf0f"} Jul 22 12:39:20.279054 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:20.279015 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:20.327487 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:20.327459 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca\") pod \"7622de4e-6a47-47bf-994a-6690fa645d20\" (UID: \"7622de4e-6a47-47bf-994a-6690fa645d20\") " Jul 22 12:39:20.327826 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:20.327805 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7622de4e-6a47-47bf-994a-6690fa645d20" (UID: "7622de4e-6a47-47bf-994a-6690fa645d20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:39:20.429238 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:20.429141 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7622de4e-6a47-47bf-994a-6690fa645d20-maas-api-service-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:39:21.152564 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:21.152536 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" Jul 22 12:39:21.152720 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:21.152577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt" event={"ID":"7622de4e-6a47-47bf-994a-6690fa645d20","Type":"ContainerDied","Data":"50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc"} Jul 22 12:39:21.152720 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:21.152630 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a8b2edb8f3c2b66df7b95e8c5782719efe58d8d8800556aed6f49ee59043bc" Jul 22 12:39:30.560838 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:30.560796 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt"] Jul 22 12:39:30.563144 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:30.563119 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5e8367-qvcwt"] Jul 22 12:39:30.602478 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:39:30.602447 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7622de4e-6a47-47bf-994a-6690fa645d20" path="/var/lib/kubelet/pods/7622de4e-6a47-47bf-994a-6690fa645d20/volumes" Jul 22 12:41:36.716234 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:41:36.716204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:41:36.725003 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:41:36.724979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:45:00.149097 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.148999 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4"] Jul 22 12:45:00.149686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.149665 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7622de4e-6a47-47bf-994a-6690fa645d20" containerName="revoke-keys" Jul 22 12:45:00.149774 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.149689 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7622de4e-6a47-47bf-994a-6690fa645d20" containerName="revoke-keys" Jul 22 12:45:00.149830 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.149805 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7622de4e-6a47-47bf-994a-6690fa645d20" containerName="revoke-keys" Jul 22 12:45:00.152883 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.152861 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l"] Jul 22 12:45:00.153016 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.152974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" Jul 22 12:45:00.155484 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.155465 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87ltg\"" Jul 22 12:45:00.156318 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.156300 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59"] Jul 22 12:45:00.156414 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.156400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" Jul 22 12:45:00.160359 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.160338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" Jul 22 12:45:00.161600 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.161580 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59"] Jul 22 12:45:00.164232 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.164211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4"] Jul 22 12:45:00.167786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.167764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l"] Jul 22 12:45:00.168856 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.168839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" Jul 22 12:45:00.176397 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.176381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" Jul 22 12:45:00.219539 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.219317 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" Jul 22 12:45:00.347027 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.346985 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4"] Jul 22 12:45:00.349447 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:45:00.349411 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode875a0cd_1e7c_478b_b413_d747eea1d25e.slice/crio-65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f WatchSource:0}: Error finding container 65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f: Status 404 returned error can't find the container with id 65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f Jul 22 12:45:00.400947 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.400922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59"] Jul 22 12:45:00.402409 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:45:00.402385 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b41c1c0_ed55_413d_83de_7fa5e88aa5a0.slice/crio-876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3 WatchSource:0}: Error finding container 876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3: Status 404 returned error can't find the container with id 876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3 Jul 22 12:45:00.579095 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:00.579063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l"] Jul 22 12:45:00.580125 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:45:00.580102 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad03a6e_51eb_45b8_9fff_ae557f561ca9.slice/crio-b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419 WatchSource:0}: Error finding container b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419: Status 404 returned error can't find the container with id b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419 Jul 22 12:45:01.091123 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.091086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" event={"ID":"e875a0cd-1e7c-478b-b413-d747eea1d25e","Type":"ContainerStarted","Data":"d85ea74c6ceae16c24d0db1ea28dc69e339d85a9e57c2d4e7fbbd97623260c0d"} Jul 22 12:45:01.091333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.091150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" event={"ID":"e875a0cd-1e7c-478b-b413-d747eea1d25e","Type":"ContainerStarted","Data":"65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f"} Jul 22 12:45:01.092628 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.092599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" event={"ID":"9b41c1c0-ed55-413d-83de-7fa5e88aa5a0","Type":"ContainerStarted","Data":"68200aedfb8af1a9ef8ade0af446611812fad063699cd5744b05fd2d461792cd"} Jul 22 12:45:01.092746 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.092650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" event={"ID":"9b41c1c0-ed55-413d-83de-7fa5e88aa5a0","Type":"ContainerStarted","Data":"876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3"} Jul 22 12:45:01.093967 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.093942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" event={"ID":"3ad03a6e-51eb-45b8-9fff-ae557f561ca9","Type":"ContainerStarted","Data":"8a602c6f775c294b0a85b6fefbd7f8141da2ba2d6c598f925d93561eba72d803"} Jul 22 12:45:01.094071 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.093986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" event={"ID":"3ad03a6e-51eb-45b8-9fff-ae557f561ca9","Type":"ContainerStarted","Data":"b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419"} Jul 22 12:45:01.109533 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.109490 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" podStartSLOduration=1.109476395 podStartE2EDuration="1.109476395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:45:01.106694981 +0000 UTC m=+2605.127085084" watchObservedRunningTime="2026-07-22 12:45:01.109476395 +0000 UTC m=+2605.129866497" Jul 22 12:45:01.122143 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.122083 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" podStartSLOduration=1.12206896 podStartE2EDuration="1.12206896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:45:01.121297944 +0000 UTC m=+2605.141688047" watchObservedRunningTime="2026-07-22 12:45:01.12206896 +0000 UTC m=+2605.142459056" Jul 22 12:45:01.137571 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:01.137526 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" podStartSLOduration=1.137512861 podStartE2EDuration="1.137512861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:45:01.137155594 +0000 UTC m=+2605.157545698" watchObservedRunningTime="2026-07-22 12:45:01.137512861 +0000 UTC m=+2605.157902963" Jul 22 12:45:02.102290 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.102258 2564 generic.go:356] "Generic (PLEG): container finished" podID="9b41c1c0-ed55-413d-83de-7fa5e88aa5a0" containerID="68200aedfb8af1a9ef8ade0af446611812fad063699cd5744b05fd2d461792cd" exitCode=0 Jul 22 12:45:02.102721 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.102336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" event={"ID":"9b41c1c0-ed55-413d-83de-7fa5e88aa5a0","Type":"ContainerDied","Data":"68200aedfb8af1a9ef8ade0af446611812fad063699cd5744b05fd2d461792cd"} Jul 22 12:45:02.103801 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.103775 2564 generic.go:356] "Generic (PLEG): container finished" podID="3ad03a6e-51eb-45b8-9fff-ae557f561ca9" containerID="8a602c6f775c294b0a85b6fefbd7f8141da2ba2d6c598f925d93561eba72d803" exitCode=0 Jul 22 12:45:02.103941 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.103854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" event={"ID":"3ad03a6e-51eb-45b8-9fff-ae557f561ca9","Type":"ContainerDied","Data":"8a602c6f775c294b0a85b6fefbd7f8141da2ba2d6c598f925d93561eba72d803"} Jul 22 12:45:02.105277 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.105252 2564 generic.go:356] "Generic (PLEG): container finished" podID="e875a0cd-1e7c-478b-b413-d747eea1d25e" containerID="d85ea74c6ceae16c24d0db1ea28dc69e339d85a9e57c2d4e7fbbd97623260c0d" exitCode=0 Jul 22 12:45:02.105394 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:02.105291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" event={"ID":"e875a0cd-1e7c-478b-b413-d747eea1d25e","Type":"ContainerDied","Data":"d85ea74c6ceae16c24d0db1ea28dc69e339d85a9e57c2d4e7fbbd97623260c0d"} Jul 22 12:45:03.251850 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:03.251824 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" Jul 22 12:45:03.287638 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:03.287618 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" Jul 22 12:45:03.290753 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:03.290734 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" Jul 22 12:45:04.116787 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.116757 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" Jul 22 12:45:04.116973 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.116806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4" event={"ID":"e875a0cd-1e7c-478b-b413-d747eea1d25e","Type":"ContainerDied","Data":"65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f"} Jul 22 12:45:04.116973 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.116866 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65fbbc515296ecd5bba4d2664748666038986c3470bdeaa0bbf0e05bc1db9e8f" Jul 22 12:45:04.118236 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.118210 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" Jul 22 12:45:04.118236 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.118215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59" event={"ID":"9b41c1c0-ed55-413d-83de-7fa5e88aa5a0","Type":"ContainerDied","Data":"876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3"} Jul 22 12:45:04.118409 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.118256 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="876b035fc0745e39c06db1a152dcd49e8634b7f3e34d06cabd8add9eb5a21ae3" Jul 22 12:45:04.119646 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.119626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" event={"ID":"3ad03a6e-51eb-45b8-9fff-ae557f561ca9","Type":"ContainerDied","Data":"b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419"} Jul 22 12:45:04.119775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.119654 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745405-bvd8l" Jul 22 12:45:04.119775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:04.119664 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7303cbdc424292059e2ba2d9cc3bebc21a74a2192b46147ee872637c0ce2419" Jul 22 12:45:41.516005 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:45:41.515971 2564 scope.go:117] "RemoveContainer" containerID="102d86c12694906437c0821344eec04ea82c2d78b766033337f9cf3f964eaf0f" Jul 22 12:46:36.755286 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:46:36.755217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:46:36.766887 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:46:36.766864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:47:17.545337 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545309 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006582320"] Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545701 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad03a6e-51eb-45b8-9fff-ae557f561ca9" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545712 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad03a6e-51eb-45b8-9fff-ae557f561ca9" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545731 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e875a0cd-1e7c-478b-b413-d747eea1d25e" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545736 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e875a0cd-1e7c-478b-b413-d747eea1d25e" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545748 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b41c1c0-ed55-413d-83de-7fa5e88aa5a0" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545753 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b41c1c0-ed55-413d-83de-7fa5e88aa5a0" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545815 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b41c1c0-ed55-413d-83de-7fa5e88aa5a0" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545827 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e875a0cd-1e7c-478b-b413-d747eea1d25e" containerName="cleanup" Jul 22 12:47:17.545844 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.545833 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad03a6e-51eb-45b8-9fff-ae557f561ca9" containerName="cleanup" Jul 22 12:47:17.548775 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.548750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:17.550711 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.550691 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4plst\"" Jul 22 12:47:17.556592 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.556570 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006582320"] Jul 22 12:47:17.586601 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.586571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqn4\" (UniqueName: \"kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4\") pod \"test-curl-7576-140289006582320\" (UID: \"14264737-db50-4284-86d7-8938a52946e4\") " pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:17.687248 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.687222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqn4\" (UniqueName: \"kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4\") pod \"test-curl-7576-140289006582320\" (UID: \"14264737-db50-4284-86d7-8938a52946e4\") " pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:17.695943 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.695917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqn4\" (UniqueName: \"kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4\") pod \"test-curl-7576-140289006582320\" (UID: \"14264737-db50-4284-86d7-8938a52946e4\") " pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:17.858734 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.858676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:17.996870 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.996844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006582320"] Jul 22 12:47:17.998149 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:17.998116 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14264737_db50_4284_86d7_8938a52946e4.slice/crio-31b39a2f26ea9af58ec33967ad007347c02d6a3bf6025123db54c1e03eb10b7e WatchSource:0}: Error finding container 31b39a2f26ea9af58ec33967ad007347c02d6a3bf6025123db54c1e03eb10b7e: Status 404 returned error can't find the container with id 31b39a2f26ea9af58ec33967ad007347c02d6a3bf6025123db54c1e03eb10b7e Jul 22 12:47:17.999554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:17.999539 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:47:18.904866 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:18.904835 2564 generic.go:356] "Generic (PLEG): container finished" podID="14264737-db50-4284-86d7-8938a52946e4" containerID="f63043e82e0dd8a1c9a5cab86d3bed8c217a7b12f3c06763f438ae39170f28bc" exitCode=0 Jul 22 12:47:18.905301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:18.904924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006582320" event={"ID":"14264737-db50-4284-86d7-8938a52946e4","Type":"ContainerDied","Data":"f63043e82e0dd8a1c9a5cab86d3bed8c217a7b12f3c06763f438ae39170f28bc"} Jul 22 12:47:18.905301 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:18.904965 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006582320" event={"ID":"14264737-db50-4284-86d7-8938a52946e4","Type":"ContainerStarted","Data":"31b39a2f26ea9af58ec33967ad007347c02d6a3bf6025123db54c1e03eb10b7e"} Jul 22 12:47:20.051120 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.051089 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:20.086383 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.086343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006582320_14264737-db50-4284-86d7-8938a52946e4/test-curl-7576-140289006582320/0.log" Jul 22 12:47:20.111131 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.111095 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006582320"] Jul 22 12:47:20.115465 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.115437 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006582320"] Jul 22 12:47:20.115673 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.115650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvqn4\" (UniqueName: \"kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4\") pod \"14264737-db50-4284-86d7-8938a52946e4\" (UID: \"14264737-db50-4284-86d7-8938a52946e4\") " Jul 22 12:47:20.117856 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.117827 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4" (OuterVolumeSpecName: "kube-api-access-jvqn4") pod "14264737-db50-4284-86d7-8938a52946e4" (UID: "14264737-db50-4284-86d7-8938a52946e4"). InnerVolumeSpecName "kube-api-access-jvqn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:20.217177 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.217091 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvqn4\" (UniqueName: \"kubernetes.io/projected/14264737-db50-4284-86d7-8938a52946e4-kube-api-access-jvqn4\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:20.239435 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.239401 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006582448"] Jul 22 12:47:20.239834 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.239821 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14264737-db50-4284-86d7-8938a52946e4" containerName="test-curl-7576-140289006582320" Jul 22 12:47:20.239888 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.239835 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14264737-db50-4284-86d7-8938a52946e4" containerName="test-curl-7576-140289006582320" Jul 22 12:47:20.239925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.239900 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14264737-db50-4284-86d7-8938a52946e4" containerName="test-curl-7576-140289006582320" Jul 22 12:47:20.242995 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.242979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:20.253365 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.253337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006582448"] Jul 22 12:47:20.318388 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.318345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxnh\" (UniqueName: \"kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh\") pod \"test-curl-7576-140289006582448\" (UID: \"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b\") " pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:20.419577 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.419530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxnh\" (UniqueName: \"kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh\") pod \"test-curl-7576-140289006582448\" (UID: \"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b\") " pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:20.429264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.429233 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxnh\" (UniqueName: \"kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh\") pod \"test-curl-7576-140289006582448\" (UID: \"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b\") " pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:20.553117 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.553082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:20.596772 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.596734 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14264737-db50-4284-86d7-8938a52946e4" path="/var/lib/kubelet/pods/14264737-db50-4284-86d7-8938a52946e4/volumes" Jul 22 12:47:20.694796 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.694765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006582448"] Jul 22 12:47:20.696330 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:20.696302 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc777ec1_6f57_48d5_9881_f9e7d6d9ab6b.slice/crio-e226a22cf43f40231521e16c81c9c54df031a82ae0daebc3152f5a691bdfc5b1 WatchSource:0}: Error finding container e226a22cf43f40231521e16c81c9c54df031a82ae0daebc3152f5a691bdfc5b1: Status 404 returned error can't find the container with id e226a22cf43f40231521e16c81c9c54df031a82ae0daebc3152f5a691bdfc5b1 Jul 22 12:47:20.917480 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.917382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006582448" event={"ID":"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b","Type":"ContainerStarted","Data":"e226a22cf43f40231521e16c81c9c54df031a82ae0daebc3152f5a691bdfc5b1"} Jul 22 12:47:20.918573 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.918551 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582320" Jul 22 12:47:20.918706 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:20.918577 2564 scope.go:117] "RemoveContainer" containerID="f63043e82e0dd8a1c9a5cab86d3bed8c217a7b12f3c06763f438ae39170f28bc" Jul 22 12:47:21.927333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:21.927298 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" containerID="cf47ad2af1c3c6fc3fd45e07538871b9798d5b3802eb16e8ca37f7c89f1257f0" exitCode=0 Jul 22 12:47:21.927809 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:21.927374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006582448" event={"ID":"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b","Type":"ContainerDied","Data":"cf47ad2af1c3c6fc3fd45e07538871b9798d5b3802eb16e8ca37f7c89f1257f0"} Jul 22 12:47:23.081625 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.081597 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:23.104374 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.104346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006582448_bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b/test-curl-7576-140289006582448/0.log" Jul 22 12:47:23.130757 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.130721 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006582448"] Jul 22 12:47:23.136809 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.136773 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006582448"] Jul 22 12:47:23.148198 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.148163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fxnh\" (UniqueName: \"kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh\") pod \"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b\" (UID: \"bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b\") " Jul 22 12:47:23.150505 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.150478 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh" (OuterVolumeSpecName: "kube-api-access-5fxnh") pod "bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" (UID: "bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b"). InnerVolumeSpecName "kube-api-access-5fxnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:23.250073 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.249949 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fxnh\" (UniqueName: \"kubernetes.io/projected/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b-kube-api-access-5fxnh\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:23.305246 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.305201 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:23.305732 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.305712 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" containerName="test-curl-7576-140289006582448" Jul 22 12:47:23.305835 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.305734 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" containerName="test-curl-7576-140289006582448" Jul 22 12:47:23.305893 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.305843 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" containerName="test-curl-7576-140289006582448" Jul 22 12:47:23.309266 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.309240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:23.315000 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.314970 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:23.350765 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.350722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cp9\" (UniqueName: \"kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9\") pod \"test-curl-7576-140289006814240\" (UID: \"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:23.452139 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.452095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cp9\" (UniqueName: \"kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9\") pod \"test-curl-7576-140289006814240\" (UID: \"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:23.462649 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.462609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cp9\" (UniqueName: \"kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9\") pod \"test-curl-7576-140289006814240\" (UID: \"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:23.622277 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.622231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:23.778211 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.778181 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:23.780168 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:23.780126 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0fa000f_6b0c_4eb8_b93a_584fcca4a1e7.slice/crio-d1d140432302f4d5cad7f71ff2d302321b5e2a79f18b63a81735aa63fe47bccd WatchSource:0}: Error finding container d1d140432302f4d5cad7f71ff2d302321b5e2a79f18b63a81735aa63fe47bccd: Status 404 returned error can't find the container with id d1d140432302f4d5cad7f71ff2d302321b5e2a79f18b63a81735aa63fe47bccd Jul 22 12:47:23.943144 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.943052 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:23.943144 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.943072 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e226a22cf43f40231521e16c81c9c54df031a82ae0daebc3152f5a691bdfc5b1" Jul 22 12:47:23.944461 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:23.944429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006814240" event={"ID":"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7","Type":"ContainerStarted","Data":"d1d140432302f4d5cad7f71ff2d302321b5e2a79f18b63a81735aa63fe47bccd"} Jul 22 12:47:23.954129 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:47:23.954099 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140289006582448\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" podUID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" pod="opendatahub/test-curl-7576-140289006582448" Jul 22 12:47:24.596433 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:24.596398 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b" path="/var/lib/kubelet/pods/bc777ec1-6f57-48d5-9881-f9e7d6d9ab6b/volumes" Jul 22 12:47:24.960591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:24.960490 2564 generic.go:356] "Generic (PLEG): container finished" podID="c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" containerID="a410f7f2fcfbc2c3e165dc1e8097b9fe06749baee9b52bfa250652f6d5477077" exitCode=0 Jul 22 12:47:24.960591 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:24.960576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006814240" event={"ID":"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7","Type":"ContainerDied","Data":"a410f7f2fcfbc2c3e165dc1e8097b9fe06749baee9b52bfa250652f6d5477077"} Jul 22 12:47:26.114782 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.114746 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.138933 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.138887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006814240_c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7/test-curl-7576-140289006814240/0.log" Jul 22 12:47:26.166545 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.166500 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:26.169068 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.169030 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:26.178954 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.178921 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4cp9\" (UniqueName: \"kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9\") pod \"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7\" (UID: \"c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7\") " Jul 22 12:47:26.181175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.181140 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9" (OuterVolumeSpecName: "kube-api-access-t4cp9") pod "c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" (UID: "c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7"). InnerVolumeSpecName "kube-api-access-t4cp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:26.280552 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.280512 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4cp9\" (UniqueName: \"kubernetes.io/projected/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7-kube-api-access-t4cp9\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:26.291143 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.291104 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:26.291652 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.291630 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" containerName="test-curl-7576-140289006814240" Jul 22 12:47:26.291768 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.291653 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" containerName="test-curl-7576-140289006814240" Jul 22 12:47:26.291768 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.291757 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" containerName="test-curl-7576-140289006814240" Jul 22 12:47:26.294905 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.294880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.304396 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.304363 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:26.381616 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.381561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppf9s\" (UniqueName: \"kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s\") pod \"test-curl-7576-140289006814240\" (UID: \"15b4f7fe-ad22-4501-bd20-8b4be9ae066d\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.482925 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.482872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppf9s\" (UniqueName: \"kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s\") pod \"test-curl-7576-140289006814240\" (UID: \"15b4f7fe-ad22-4501-bd20-8b4be9ae066d\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.493050 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.493012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppf9s\" (UniqueName: \"kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s\") pod \"test-curl-7576-140289006814240\" (UID: \"15b4f7fe-ad22-4501-bd20-8b4be9ae066d\") " pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.596652 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.596568 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7" path="/var/lib/kubelet/pods/c0fa000f-6b0c-4eb8-b93a-584fcca4a1e7/volumes" Jul 22 12:47:26.606523 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.606500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.761023 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.760995 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:26.762865 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:26.762832 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15b4f7fe_ad22_4501_bd20_8b4be9ae066d.slice/crio-3af43dac1837e1bbc0d4a745363a540ae4d55abd63b165cf1e7e183a8014a80a WatchSource:0}: Error finding container 3af43dac1837e1bbc0d4a745363a540ae4d55abd63b165cf1e7e183a8014a80a: Status 404 returned error can't find the container with id 3af43dac1837e1bbc0d4a745363a540ae4d55abd63b165cf1e7e183a8014a80a Jul 22 12:47:26.973907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.973814 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:26.973907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.973826 2564 scope.go:117] "RemoveContainer" containerID="a410f7f2fcfbc2c3e165dc1e8097b9fe06749baee9b52bfa250652f6d5477077" Jul 22 12:47:26.975284 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:26.975255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006814240" event={"ID":"15b4f7fe-ad22-4501-bd20-8b4be9ae066d","Type":"ContainerStarted","Data":"3af43dac1837e1bbc0d4a745363a540ae4d55abd63b165cf1e7e183a8014a80a"} Jul 22 12:47:27.984432 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:27.984398 2564 generic.go:356] "Generic (PLEG): container finished" podID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" containerID="32b6df37726e0bf3a503d52736d310911cc69454bbc1b98b62a658cf39ca2c32" exitCode=0 Jul 22 12:47:27.984847 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:27.984468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006814240" event={"ID":"15b4f7fe-ad22-4501-bd20-8b4be9ae066d","Type":"ContainerDied","Data":"32b6df37726e0bf3a503d52736d310911cc69454bbc1b98b62a658cf39ca2c32"} Jul 22 12:47:29.130134 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.130100 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:29.153672 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.153613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006814240_15b4f7fe-ad22-4501-bd20-8b4be9ae066d/test-curl-7576-140289006814240/0.log" Jul 22 12:47:29.179459 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.179395 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:29.183759 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.183729 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006814240"] Jul 22 12:47:29.210945 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.210903 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppf9s\" (UniqueName: \"kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s\") pod \"15b4f7fe-ad22-4501-bd20-8b4be9ae066d\" (UID: \"15b4f7fe-ad22-4501-bd20-8b4be9ae066d\") " Jul 22 12:47:29.213025 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.212995 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s" (OuterVolumeSpecName: "kube-api-access-ppf9s") pod "15b4f7fe-ad22-4501-bd20-8b4be9ae066d" (UID: "15b4f7fe-ad22-4501-bd20-8b4be9ae066d"). InnerVolumeSpecName "kube-api-access-ppf9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:29.312495 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.312446 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppf9s\" (UniqueName: \"kubernetes.io/projected/15b4f7fe-ad22-4501-bd20-8b4be9ae066d-kube-api-access-ppf9s\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:29.322102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.316099 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:29.322102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.317108 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" containerName="test-curl-7576-140289006814240" Jul 22 12:47:29.322102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.317132 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" containerName="test-curl-7576-140289006814240" Jul 22 12:47:29.322102 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.317365 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" containerName="test-curl-7576-140289006814240" Jul 22 12:47:29.323483 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.323446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:29.326295 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.326267 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:29.414001 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.413957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q69k\" (UniqueName: \"kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k\") pod \"test-curl-7576-140289006815248\" (UID: \"ed28ec55-ee37-415b-9d6a-fe97ce6eee49\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:29.515071 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.514999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q69k\" (UniqueName: \"kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k\") pod \"test-curl-7576-140289006815248\" (UID: \"ed28ec55-ee37-415b-9d6a-fe97ce6eee49\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:29.532410 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.532373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q69k\" (UniqueName: \"kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k\") pod \"test-curl-7576-140289006815248\" (UID: \"ed28ec55-ee37-415b-9d6a-fe97ce6eee49\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:29.633842 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.633748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:29.784606 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.784578 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:29.786624 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:29.786595 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded28ec55_ee37_415b_9d6a_fe97ce6eee49.slice/crio-ec7d43652aa50193ed96effb07fb68070428cf2ad9c75c408a2ccfe87074e2a6 WatchSource:0}: Error finding container ec7d43652aa50193ed96effb07fb68070428cf2ad9c75c408a2ccfe87074e2a6: Status 404 returned error can't find the container with id ec7d43652aa50193ed96effb07fb68070428cf2ad9c75c408a2ccfe87074e2a6 Jul 22 12:47:29.998959 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.998866 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:29.998959 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:29.998871 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3af43dac1837e1bbc0d4a745363a540ae4d55abd63b165cf1e7e183a8014a80a" Jul 22 12:47:30.000175 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:30.000133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006815248" event={"ID":"ed28ec55-ee37-415b-9d6a-fe97ce6eee49","Type":"ContainerStarted","Data":"ec7d43652aa50193ed96effb07fb68070428cf2ad9c75c408a2ccfe87074e2a6"} Jul 22 12:47:30.010057 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:47:30.010013 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140289006814240\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" podUID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" pod="opendatahub/test-curl-7576-140289006814240" Jul 22 12:47:30.595265 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:30.595231 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b4f7fe-ad22-4501-bd20-8b4be9ae066d" path="/var/lib/kubelet/pods/15b4f7fe-ad22-4501-bd20-8b4be9ae066d/volumes" Jul 22 12:47:31.007510 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:31.007409 2564 generic.go:356] "Generic (PLEG): container finished" podID="ed28ec55-ee37-415b-9d6a-fe97ce6eee49" containerID="350054b2b6749649eeed95e8b47103e3b3245a7ecfd4929cc97eb63ca44461b9" exitCode=0 Jul 22 12:47:31.007510 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:31.007491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006815248" event={"ID":"ed28ec55-ee37-415b-9d6a-fe97ce6eee49","Type":"ContainerDied","Data":"350054b2b6749649eeed95e8b47103e3b3245a7ecfd4929cc97eb63ca44461b9"} Jul 22 12:47:32.151617 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.151589 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.179345 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.179312 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006815248_ed28ec55-ee37-415b-9d6a-fe97ce6eee49/test-curl-7576-140289006815248/0.log" Jul 22 12:47:32.211264 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.211223 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:32.218484 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.218453 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:32.242615 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.242583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q69k\" (UniqueName: \"kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k\") pod \"ed28ec55-ee37-415b-9d6a-fe97ce6eee49\" (UID: \"ed28ec55-ee37-415b-9d6a-fe97ce6eee49\") " Jul 22 12:47:32.244964 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.244934 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k" (OuterVolumeSpecName: "kube-api-access-2q69k") pod "ed28ec55-ee37-415b-9d6a-fe97ce6eee49" (UID: "ed28ec55-ee37-415b-9d6a-fe97ce6eee49"). InnerVolumeSpecName "kube-api-access-2q69k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:32.343671 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.343608 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q69k\" (UniqueName: \"kubernetes.io/projected/ed28ec55-ee37-415b-9d6a-fe97ce6eee49-kube-api-access-2q69k\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:32.347696 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.347647 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:32.348169 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.348149 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed28ec55-ee37-415b-9d6a-fe97ce6eee49" containerName="test-curl-7576-140289006815248" Jul 22 12:47:32.348225 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.348171 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed28ec55-ee37-415b-9d6a-fe97ce6eee49" containerName="test-curl-7576-140289006815248" Jul 22 12:47:32.348263 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.348254 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed28ec55-ee37-415b-9d6a-fe97ce6eee49" containerName="test-curl-7576-140289006815248" Jul 22 12:47:32.351804 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.351775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.360378 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.360337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:32.444492 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.444449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zbs2\" (UniqueName: \"kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2\") pod \"test-curl-7576-140289006815248\" (UID: \"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.545436 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.545390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zbs2\" (UniqueName: \"kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2\") pod \"test-curl-7576-140289006815248\" (UID: \"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.554809 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.554780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zbs2\" (UniqueName: \"kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2\") pod \"test-curl-7576-140289006815248\" (UID: \"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5\") " pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.595393 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.595292 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed28ec55-ee37-415b-9d6a-fe97ce6eee49" path="/var/lib/kubelet/pods/ed28ec55-ee37-415b-9d6a-fe97ce6eee49/volumes" Jul 22 12:47:32.664361 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.664314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:32.828716 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:32.828686 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:32.830363 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:47:32.830336 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc10f82b_b6ce_4dd2_ba94_6ce0d106e1d5.slice/crio-eae38ceafc8644c5748816e8e90b025cca8997f0acdde05bc995ea441fd4cda0 WatchSource:0}: Error finding container eae38ceafc8644c5748816e8e90b025cca8997f0acdde05bc995ea441fd4cda0: Status 404 returned error can't find the container with id eae38ceafc8644c5748816e8e90b025cca8997f0acdde05bc995ea441fd4cda0 Jul 22 12:47:33.020553 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:33.020506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006815248" event={"ID":"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5","Type":"ContainerStarted","Data":"eae38ceafc8644c5748816e8e90b025cca8997f0acdde05bc995ea441fd4cda0"} Jul 22 12:47:33.021895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:33.021876 2564 scope.go:117] "RemoveContainer" containerID="350054b2b6749649eeed95e8b47103e3b3245a7ecfd4929cc97eb63ca44461b9" Jul 22 12:47:33.022031 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:33.021904 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:34.036346 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:34.036310 2564 generic.go:356] "Generic (PLEG): container finished" podID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" containerID="0f4b7682fa4ce359c06605a396d7e894bf748b601a50ba64b1a6e042a71ce26b" exitCode=0 Jul 22 12:47:34.036935 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:34.036404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7576-140289006815248" event={"ID":"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5","Type":"ContainerDied","Data":"0f4b7682fa4ce359c06605a396d7e894bf748b601a50ba64b1a6e042a71ce26b"} Jul 22 12:47:35.191638 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.191612 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:35.215379 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.215349 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7576-140289006815248_fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5/test-curl-7576-140289006815248/0.log" Jul 22 12:47:35.245313 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.245276 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:35.248980 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.248948 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7576-140289006815248"] Jul 22 12:47:35.275343 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.275304 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zbs2\" (UniqueName: \"kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2\") pod \"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5\" (UID: \"fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5\") " Jul 22 12:47:35.277459 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.277429 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2" (OuterVolumeSpecName: "kube-api-access-9zbs2") pod "fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" (UID: "fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5"). InnerVolumeSpecName "kube-api-access-9zbs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:47:35.376142 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:35.376020 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zbs2\" (UniqueName: \"kubernetes.io/projected/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5-kube-api-access-9zbs2\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Jul 22 12:47:36.049984 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:36.049947 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:36.049984 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:36.049989 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eae38ceafc8644c5748816e8e90b025cca8997f0acdde05bc995ea441fd4cda0" Jul 22 12:47:36.060166 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:47:36.060132 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140289006815248\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:36.594162 ip-10-0-138-35 kubenswrapper[2564]: E0722 12:47:36.594124 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7576-140289006815248\" is forbidden: User \"system:node:ip-10-0-138-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-35.ec2.internal' and this object" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" pod="opendatahub/test-curl-7576-140289006815248" Jul 22 12:47:36.595969 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:36.595947 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" path="/var/lib/kubelet/pods/fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5/volumes" Jul 22 12:47:45.997202 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:45.997157 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4"] Jul 22 12:47:46.000895 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:46.000858 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a12988-29745405-p56r4"] Jul 22 12:47:46.595810 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:47:46.595777 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e875a0cd-1e7c-478b-b413-d747eea1d25e" path="/var/lib/kubelet/pods/e875a0cd-1e7c-478b-b413-d747eea1d25e/volumes" Jul 22 12:48:10.263524 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:10.263438 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59"] Jul 22 12:48:10.265773 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:10.265751 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-980f27-29745405-tjs59"] Jul 22 12:48:10.596485 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:10.596452 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b41c1c0-ed55-413d-83de-7fa5e88aa5a0" path="/var/lib/kubelet/pods/9b41c1c0-ed55-413d-83de-7fa5e88aa5a0/volumes" Jul 22 12:48:22.987686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:22.987638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8484dbc5-qjg5h_1bb9cf62-9831-42a0-bb2d-2afa6bf63147/authorino/0.log" Jul 22 12:48:29.570353 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:29.570323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-979495d87-thg7m_6a2b2d98-eaee-4141-a277-3a8c6b74e8b7/copy-manifests/0.log" Jul 22 12:48:29.584398 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:29.584367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-979495d87-thg7m_6a2b2d98-eaee-4141-a277-3a8c6b74e8b7/manager/0.log" Jul 22 12:48:30.274033 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:30.273999 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745405-bvd8l_3ad03a6e-51eb-45b8-9fff-ae557f561ca9/cleanup/0.log" Jul 22 12:48:31.161990 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.161956 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/extract/0.log" Jul 22 12:48:31.168803 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.168778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/util/0.log" Jul 22 12:48:31.176469 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.176443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/pull/0.log" Jul 22 12:48:31.291478 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.291450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/pull/0.log" Jul 22 12:48:31.298353 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.298325 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/extract/0.log" Jul 22 12:48:31.305314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.305282 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/util/0.log" Jul 22 12:48:31.425117 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.425008 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/util/0.log" Jul 22 12:48:31.433053 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.433018 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/pull/0.log" Jul 22 12:48:31.441060 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.441025 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/extract/0.log" Jul 22 12:48:31.554318 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.554289 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/util/0.log" Jul 22 12:48:31.562109 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.562080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/pull/0.log" Jul 22 12:48:31.569249 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.569212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/extract/0.log" Jul 22 12:48:31.684253 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:31.684165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8484dbc5-qjg5h_1bb9cf62-9831-42a0-bb2d-2afa6bf63147/authorino/0.log" Jul 22 12:48:32.025754 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:32.025730 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98tb2_1b4ecdbe-2490-41c7-9535-3335f1a394e4/kuadrant-console-plugin/0.log" Jul 22 12:48:33.102741 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:33.102710 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f68f699cd-g2qcw_934cf675-5924-4b97-9905-aeab401309ae/kube-auth-proxy/0.log" Jul 22 12:48:33.463479 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:33.463394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8f5mm_ae44066e-81b6-426c-a1ba-6a7566e65d06/payload-pre-processing/0.log" Jul 22 12:48:33.576517 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:33.576488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-msgqr_b704ab56-635c-4a60-831a-aa55a14bf40f/payload-processing/0.log" Jul 22 12:48:34.148478 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:34.148438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-htrmn_696f0b01-a565-41b3-a817-d6f63fd8cdba/main/0.log" Jul 22 12:48:34.384227 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:34.384187 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fv5vk2_d0b996e1-9586-41b8-bdae-1a6fc7ad4ec7/main/0.log" Jul 22 12:48:34.621256 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:34.621215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-d4nng_f6160b4f-24d0-464b-b8b5-a1e8b833b8f1/main/0.log" Jul 22 12:48:42.920393 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:42.920359 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z9tjg_abb4b91e-07e3-4a38-93c9-738f4cdffb8c/global-pull-secret-syncer/0.log" Jul 22 12:48:43.045178 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:43.045150 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m9hz6_317c191d-3c84-4589-afa9-310f326ea742/konnectivity-agent/0.log" Jul 22 12:48:43.175906 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:43.175849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-35.ec2.internal_42d441b9abef2428e8e0502c51e24a66/haproxy/0.log" Jul 22 12:48:47.745538 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.745500 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/extract/0.log" Jul 22 12:48:47.789129 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.789103 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/util/0.log" Jul 22 12:48:47.824706 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.824683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqnkq_d2f5cfd7-36bf-4765-93c8-d2c6663854ce/pull/0.log" Jul 22 12:48:47.853988 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.853972 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/extract/0.log" Jul 22 12:48:47.880162 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.880142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/util/0.log" Jul 22 12:48:47.909345 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.909324 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d4gpp_9540337c-08f2-492d-b981-c7b237691323/pull/0.log" Jul 22 12:48:47.942168 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.942147 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/extract/0.log" Jul 22 12:48:47.979334 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:47.979315 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/util/0.log" Jul 22 12:48:48.003821 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.003772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v86xg_27ce7331-8557-4259-b265-bd274561ee0a/pull/0.log" Jul 22 12:48:48.033759 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.033736 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/extract/0.log" Jul 22 12:48:48.055923 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.055905 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/util/0.log" Jul 22 12:48:48.079938 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.079915 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6hbp_b2e3c5d5-d784-41bb-807e-7e9257ea45a3/pull/0.log" Jul 22 12:48:48.418902 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.418862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8484dbc5-qjg5h_1bb9cf62-9831-42a0-bb2d-2afa6bf63147/authorino/0.log" Jul 22 12:48:48.514367 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:48.514337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98tb2_1b4ecdbe-2490-41c7-9535-3335f1a394e4/kuadrant-console-plugin/0.log" Jul 22 12:48:50.539984 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.539953 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/alertmanager/0.log" Jul 22 12:48:50.563281 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.563253 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/config-reloader/0.log" Jul 22 12:48:50.587233 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.587207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/kube-rbac-proxy-web/0.log" Jul 22 12:48:50.615017 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.614992 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/kube-rbac-proxy/0.log" Jul 22 12:48:50.642412 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.642381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/kube-rbac-proxy-metric/0.log" Jul 22 12:48:50.672878 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.672844 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/prom-label-proxy/0.log" Jul 22 12:48:50.706178 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.706150 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37e8d675-b1a3-49f5-b9aa-535d90336c02/init-config-reloader/0.log" Jul 22 12:48:50.875570 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.875470 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79fc7b9889-9zq6r_389f942a-7002-4efb-a3b4-1130666dea57/metrics-server/0.log" Jul 22 12:48:50.905753 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:50.905725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-cfcs7_128b0d08-a38f-4ce5-8a96-41b4b69ca7c5/monitoring-plugin/0.log" Jul 22 12:48:51.129709 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.129606 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nx5rb_70f2ba60-d2c0-45ce-8858-78039c70b71e/node-exporter/0.log" Jul 22 12:48:51.159437 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.159410 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nx5rb_70f2ba60-d2c0-45ce-8858-78039c70b71e/kube-rbac-proxy/0.log" Jul 22 12:48:51.186208 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.186183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nx5rb_70f2ba60-d2c0-45ce-8858-78039c70b71e/init-textfile/0.log" Jul 22 12:48:51.216160 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.216117 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2kw2r_27f1da31-394f-477d-a8b0-69e978f90882/kube-rbac-proxy-main/0.log" Jul 22 12:48:51.242854 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.242827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2kw2r_27f1da31-394f-477d-a8b0-69e978f90882/kube-rbac-proxy-self/0.log" Jul 22 12:48:51.266564 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.266538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-2kw2r_27f1da31-394f-477d-a8b0-69e978f90882/openshift-state-metrics/0.log" Jul 22 12:48:51.589777 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.589744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jbzwr_b71ace9c-ac17-4008-adc1-9867126de1d9/prometheus-operator-admission-webhook/0.log" Jul 22 12:48:51.627160 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.627128 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9df46f68-wfncf_1abd22cd-9755-4b09-8596-ea29270428cd/telemeter-client/0.log" Jul 22 12:48:51.652546 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.652520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9df46f68-wfncf_1abd22cd-9755-4b09-8596-ea29270428cd/reload/0.log" Jul 22 12:48:51.678791 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.678759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9df46f68-wfncf_1abd22cd-9755-4b09-8596-ea29270428cd/kube-rbac-proxy/0.log" Jul 22 12:48:51.713440 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.713409 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/thanos-query/0.log" Jul 22 12:48:51.736781 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.736755 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/kube-rbac-proxy-web/0.log" Jul 22 12:48:51.761311 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.761281 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/kube-rbac-proxy/0.log" Jul 22 12:48:51.784318 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.784292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/prom-label-proxy/0.log" Jul 22 12:48:51.806321 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.806292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/kube-rbac-proxy-rules/0.log" Jul 22 12:48:51.829189 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:51.829157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c645c6b95-cxhwl_1e4e0a78-7b96-4809-8bd8-b8fc5705ad47/kube-rbac-proxy-metrics/0.log" Jul 22 12:48:52.793329 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.793289 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s"] Jul 22 12:48:52.793808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.793737 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" containerName="test-curl-7576-140289006815248" Jul 22 12:48:52.793808 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.793750 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" containerName="test-curl-7576-140289006815248" Jul 22 12:48:52.793882 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.793829 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc10f82b-b6ce-4dd2-ba94-6ce0d106e1d5" containerName="test-curl-7576-140289006815248" Jul 22 12:48:52.796991 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.796973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:52.799152 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.799131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s8cv\"/\"openshift-service-ca.crt\"" Jul 22 12:48:52.799837 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.799825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s8cv\"/\"kube-root-ca.crt\"" Jul 22 12:48:52.799889 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.799832 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9s8cv\"/\"default-dockercfg-nssjf\"" Jul 22 12:48:52.807519 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.807494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s"] Jul 22 12:48:52.915697 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.915645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-proc\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:52.915907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.915779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-podres\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:52.915907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.915812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgrn\" (UniqueName: \"kubernetes.io/projected/cba4d564-6bd4-4add-bf3b-04a137e13f91-kube-api-access-5bgrn\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:52.915907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.915838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-lib-modules\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:52.915907 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:52.915862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-sys\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.016905 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.016853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-sys\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017104 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.016952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-proc\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017104 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.016986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-sys\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017104 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-proc\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017240 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-podres\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017240 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgrn\" (UniqueName: \"kubernetes.io/projected/cba4d564-6bd4-4add-bf3b-04a137e13f91-kube-api-access-5bgrn\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017240 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-lib-modules\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017349 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-podres\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.017349 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.017311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cba4d564-6bd4-4add-bf3b-04a137e13f91-lib-modules\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.027273 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.027239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgrn\" (UniqueName: \"kubernetes.io/projected/cba4d564-6bd4-4add-bf3b-04a137e13f91-kube-api-access-5bgrn\") pod \"perf-node-gather-daemonset-7k57s\" (UID: \"cba4d564-6bd4-4add-bf3b-04a137e13f91\") " pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.108674 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.108567 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.253449 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.253420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s"] Jul 22 12:48:53.256469 ip-10-0-138-35 kubenswrapper[2564]: W0722 12:48:53.256435 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcba4d564_6bd4_4add_bf3b_04a137e13f91.slice/crio-df574185b8f2a6ad5174202b8ebed56ecce2ac8675cf1574f62a150e4646e124 WatchSource:0}: Error finding container df574185b8f2a6ad5174202b8ebed56ecce2ac8675cf1574f62a150e4646e124: Status 404 returned error can't find the container with id df574185b8f2a6ad5174202b8ebed56ecce2ac8675cf1574f62a150e4646e124 Jul 22 12:48:53.521627 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.521588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" event={"ID":"cba4d564-6bd4-4add-bf3b-04a137e13f91","Type":"ContainerStarted","Data":"6a38a14d97e38da213f9ff1c6a5419ee7d1ed82f85aecb78cf62896911d6b9ee"} Jul 22 12:48:53.521822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.521654 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:53.521822 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.521674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" event={"ID":"cba4d564-6bd4-4add-bf3b-04a137e13f91","Type":"ContainerStarted","Data":"df574185b8f2a6ad5174202b8ebed56ecce2ac8675cf1574f62a150e4646e124"} Jul 22 12:48:53.540968 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.540913 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" podStartSLOduration=1.540896591 podStartE2EDuration="1.540896591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:48:53.538573204 +0000 UTC m=+2837.558963318" watchObservedRunningTime="2026-07-22 12:48:53.540896591 +0000 UTC m=+2837.561286695" Jul 22 12:48:53.676308 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.676224 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/1.log" Jul 22 12:48:53.680295 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:53.680269 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-db6s7_9680bea8-62d6-4775-b51d-5424ab474589/console-operator/2.log" Jul 22 12:48:54.193483 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:54.193455 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c7dc85f7b-fzjg7_d1768ab4-de25-4e5d-bd9f-cc0a3751e5bc/console/0.log" Jul 22 12:48:54.229686 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:54.229653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-svsl7_ce7ee3c4-4fef-4c3b-923c-3007b3dcb57d/download-server/0.log" Jul 22 12:48:54.863168 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:54.860382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-7pqcw_c65d5881-904b-4341-995d-9889b0e8f294/volume-data-source-validator/0.log" Jul 22 12:48:56.011419 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:56.011391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfz8n_f3deab09-41a9-4ad6-8742-fb23987876c4/dns/0.log" Jul 22 12:48:56.034969 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:56.034939 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfz8n_f3deab09-41a9-4ad6-8742-fb23987876c4/kube-rbac-proxy/0.log" Jul 22 12:48:56.141311 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:56.141284 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x6nkf_cfb953d9-0662-48a1-a127-b54df59aa9bd/dns-node-resolver/0.log" Jul 22 12:48:56.811601 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:56.811568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlhgv_c55b3005-70cf-49ef-b15f-b890edbd8ccc/node-ca/0.log" Jul 22 12:48:58.099012 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:58.098979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f68f699cd-g2qcw_934cf675-5924-4b97-9905-aeab401309ae/kube-auth-proxy/0.log" Jul 22 12:48:58.227309 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:58.227277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8f5mm_ae44066e-81b6-426c-a1ba-6a7566e65d06/payload-pre-processing/0.log" Jul 22 12:48:58.258479 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:58.258450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-msgqr_b704ab56-635c-4a60-831a-aa55a14bf40f/payload-processing/0.log" Jul 22 12:48:59.021697 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.021652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6z4l_7ac0d182-1afb-48a2-8bf3-1be8486c5ea9/serve-healthcheck-canary/0.log" Jul 22 12:48:59.538554 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.538525 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-thvgj_bf85f063-1b03-4c87-af1d-1284fa950651/insights-operator/0.log" Jul 22 12:48:59.539113 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.539095 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9s8cv/perf-node-gather-daemonset-7k57s" Jul 22 12:48:59.539382 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.539363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-thvgj_bf85f063-1b03-4c87-af1d-1284fa950651/insights-operator/1.log" Jul 22 12:48:59.724577 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.724550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhjs_c768555a-20ee-44fe-ada2-685e74ca4583/kube-rbac-proxy/0.log" Jul 22 12:48:59.747820 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.747795 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhjs_c768555a-20ee-44fe-ada2-685e74ca4583/exporter/0.log" Jul 22 12:48:59.770786 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:48:59.770745 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrhjs_c768555a-20ee-44fe-ada2-685e74ca4583/extractor/0.log" Jul 22 12:49:03.301464 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:03.301431 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-979495d87-thg7m_6a2b2d98-eaee-4141-a277-3a8c6b74e8b7/manager/0.log" Jul 22 12:49:03.323446 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:03.323415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-979495d87-thg7m_6a2b2d98-eaee-4141-a277-3a8c6b74e8b7/copy-manifests/0.log" Jul 22 12:49:03.829158 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:03.829129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f68f699cd-g2qcw_934cf675-5924-4b97-9905-aeab401309ae/kube-auth-proxy/0.log" Jul 22 12:49:03.926333 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:03.926313 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8f5mm_ae44066e-81b6-426c-a1ba-6a7566e65d06/payload-pre-processing/0.log" Jul 22 12:49:03.947519 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:03.947499 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-msgqr_b704ab56-635c-4a60-831a-aa55a14bf40f/payload-processing/0.log" Jul 22 12:49:04.508558 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:04.508533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fc976ff6d-4bss6_b8f420e8-121f-4c0e-bc0d-4d4b40683bfd/manager/0.log" Jul 22 12:49:04.566938 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:04.566912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s84gd_de219c42-4ec4-485b-b58b-d7aeff3265e5/openshift-lws-operator/0.log" Jul 22 12:49:05.357640 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:05.357597 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f68f699cd-g2qcw_934cf675-5924-4b97-9905-aeab401309ae/kube-auth-proxy/0.log" Jul 22 12:49:05.456314 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:05.456282 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8f5mm_ae44066e-81b6-426c-a1ba-6a7566e65d06/payload-pre-processing/0.log" Jul 22 12:49:05.482367 ip-10-0-138-35 kubenswrapper[2564]: I0722 12:49:05.482349 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-msgqr_b704ab56-635c-4a60-831a-aa55a14bf40f/payload-processing/0.log"